-- Logs begin at Tue 2022-09-13 05:57:56 UTC, end at Tue 2022-09-13 07:01:25 UTC. -- Sep 13 06:28:49.908131 dv-cinder-856385-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 06:28:49.917422 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 06:28:49.919410 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 06:28:49 2022] *** Sep 13 06:28:49.919410 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 06:28:49.919410 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 06:28:49.919410 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: nodename: dv-cinder-856385-1-iscsi Sep 13 06:28:49.919410 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: machine: x86_64 Sep 13 06:28:49.919410 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: clock source: unix Sep 13 06:28:49.919410 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: pcre jit disabled Sep 13 06:28:49.919410 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: detected number of CPU cores: 4 Sep 13 06:28:49.919410 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: current working directory: / Sep 13 06:28:49.919410 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: detected binary path: /usr/bin/uwsgi-core Sep 13 06:28:49.919998 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: your processes number limit is 47680 Sep 13 06:28:49.919998 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: your memory page size is 4096 bytes Sep 13 06:28:49.919998 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: detected max file descriptor number: 2048 Sep 13 06:28:49.919998 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: lock engine: pthread robust mutexes Sep 13 06:28:49.919998 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: thunder lock: enabled Sep 13 06:28:49.919998 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 06:28:49.919998 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 06:28:49.958880 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: Python main interpreter initialized at 0x55d1fba719c0 Sep 13 06:28:49.958880 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: python threads support enabled Sep 13 06:28:49.958880 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: your server socket listen backlog is limited to 100 connections Sep 13 06:28:49.958880 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: your mercy for graceful operations on workers is 90 seconds Sep 13 06:28:49.959218 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 06:28:49.959296 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: *** Operational MODE: preforking *** Sep 13 06:28:49.959567 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: *** uWSGI is running in multiple interpreter mode *** Sep 13 06:28:49.959567 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: spawned uWSGI master process (pid: 105770) Sep 13 06:28:49.959748 dv-cinder-856385-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 06:28:49.961139 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: spawned uWSGI worker 1 (pid: 105771, cores: 1) Sep 13 06:28:49.961139 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: spawned uWSGI worker 2 (pid: 105772, cores: 1) Sep 13 06:28:49.961139 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 06:28:50.620279 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 06:28:50.629639 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 06:28:51.698171 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:28:51.698171 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: from cryptography.utils import int_from_bytes Sep 13 06:28:51.698841 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:28:51.698841 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: from cryptography.utils import int_from_bytes Sep 13 06:28:51.700687 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:28:51.700687 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: from cryptography.utils import int_from_bytes Sep 13 06:28:51.701146 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:28:51.701146 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: from cryptography.utils import int_from_bytes Sep 13 06:28:54.183836 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 06:28:54.184399 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 06:28:54.184605 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 06:28:54.184960 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 06:28:54.185223 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 06:28:54.185594 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.185913 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.186228 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.186423 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 06:28:54.186789 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.186884 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 06:28:54.186974 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.187148 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.187246 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 06:28:54.187488 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.187594 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 06:28:54.187803 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.187899 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 06:28:54.188126 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.188228 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.188383 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.188527 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.188694 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.188856 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.189013 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856385-1-iscsi {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.189181 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.189327 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.189514 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.189708 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.189854 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.190006 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.190175 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.190317 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.190505 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.190617 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.190849 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.190954 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.191104 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.191229 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.191451 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.191752 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.191866 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856385-1-iscsi {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.192100 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.192211 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.192411 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.192530 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.192725 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.192847 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.193048 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.193167 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.193355 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.193461 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.193671 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.193780 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.193975 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.194065 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.194275 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.194491 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.194597 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.194812 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.194899 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.195121 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.195252 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856385-1-iscsi {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.195456 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.195586 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.195853 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.195954 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.196173 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.196271 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.197004 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.197148 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.197311 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.197455 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.197623 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.197760 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.197948 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.198076 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.198261 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.198437 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.198661 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856385-1-iscsi {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.198749 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.198978 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.199075 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.199291 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.199406 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.199635 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.199720 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.199951 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.200050 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.200248 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.200334 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.200552 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.200650 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.200855 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.200950 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.201170 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.201258 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.201471 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.201568 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.201771 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.201892 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.202019 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.202218 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.202312 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.202543 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.202635 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.202868 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.202960 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.203175 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.203260 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.203485 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.203573 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.203735 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.203829 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.204053 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.204148 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.204369 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.204464 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.204673 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.204765 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.204965 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.205063 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.205268 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.205364 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.205572 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.205664 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.205873 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.205960 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.206175 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.206261 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.206463 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.206548 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.206718 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.206812 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.207042 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.207133 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.207404 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.207508 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.207704 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.207795 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.208007 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.208093 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.208317 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.208412 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.208630 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.208722 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.208939 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.209029 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.209242 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.209338 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.209551 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.209635 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.209863 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.209949 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.210166 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.210262 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.210480 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.210572 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.210796 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.210882 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.211098 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.211196 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.211446 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.211538 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.211753 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.211856 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.212069 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.212157 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.212401 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.212488 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.212702 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.212789 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.212951 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.213046 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.213247 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.213332 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.213544 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.213641 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.213860 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.213969 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.214161 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.214283 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.214464 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.214599 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.214767 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.214911 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.215063 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.215235 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.215387 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.215598 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.215738 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.215908 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.215993 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.216164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.216255 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.216469 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.216562 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.216779 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.216872 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.217100 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.217192 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.217411 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.217503 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.217709 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.217794 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.218011 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.218098 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.218312 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.218405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.218623 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.218718 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.218924 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.219017 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.219227 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.219314 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.219552 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.219640 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.219852 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.219943 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.220159 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.220243 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.220458 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.220547 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.220760 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.220852 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.221067 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.221152 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.221366 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.221456 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.221666 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.221762 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.221980 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.222073 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.222282 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.222367 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.222584 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.222678 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.222890 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.223049 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.223185 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.223276 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.223509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.223614 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.223823 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.223915 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.224123 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.224211 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.224421 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.224520 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.224719 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.224805 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.225016 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.225103 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.225314 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.225415 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.225612 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.225709 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.225907 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.225995 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.226203 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.226299 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.226497 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.226590 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.226809 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.226893 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.227673 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.227761 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.227977 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.228068 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.228278 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.228370 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.228577 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.228665 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.228880 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.228969 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.229186 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.229280 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.229497 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.229596 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.229804 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.229889 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.230110 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.230201 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.230412 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.230499 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.230732 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.230824 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.231055 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.231152 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.231381 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.231467 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.231692 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.231778 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.231998 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.232095 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.232310 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.232401 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:28:54.232618 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.232705 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.232924 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.233026 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.233239 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.233332 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.233553 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.233648 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.233877 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.233964 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.234190 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.234282 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.234503 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.234598 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.234814 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.234901 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.235118 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.235217 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.235456 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.235548 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.235782 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.235906 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.236095 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.236180 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.236400 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.236484 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.236721 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.236805 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.237044 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.237129 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.237355 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.237439 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.237680 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.237776 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.237994 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.238086 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.238299 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.238384 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.238603 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.238691 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.238907 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.239000 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.239243 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.239336 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.239594 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.239684 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.239910 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.240005 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.240254 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.240383 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.240560 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.240645 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.240877 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.240964 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.241184 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.241279 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.241490 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.241583 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.241795 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.241935 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.242101 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.242200 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.242406 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.242500 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.243338 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.243527 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.243697 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.243831 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.244021 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.244151 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.244332 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.244449 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.244648 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.244771 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.244962 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.245088 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.245271 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.245436 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.245577 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.245672 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.245882 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.246006 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.246181 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.246267 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.246482 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.246578 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.246782 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.246868 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.247087 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.247174 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.247408 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.247498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.247732 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.247818 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.248055 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.248154 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.248357 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.248455 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.248674 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.248771 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.248975 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.249069 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.249281 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.249367 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.249585 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.249670 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.249887 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.249980 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.250187 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.250275 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.250493 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.250588 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.250798 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.250898 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.251099 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.251185 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.251443 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.251533 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.251751 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.251840 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.252052 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.252138 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.252370 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.252463 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.252671 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.252759 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.252973 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.253066 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.253283 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.253366 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.253592 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.253680 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.253910 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.254001 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.254225 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.254317 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.254534 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.254621 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.254851 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.254936 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.255162 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.255262 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.255496 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.255625 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.255823 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.255918 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.256132 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.256242 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.256435 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.256544 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.256749 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.256834 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.257066 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.257171 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.257377 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.257465 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.257681 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.257768 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.257987 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.258082 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.258329 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.258414 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.258633 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.258832 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.258927 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.259223 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.259422 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.259551 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.259854 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.260015 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.260157 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.260456 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.260573 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.260757 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.261077 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.261161 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.261383 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.261666 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.261751 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.261972 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.262060 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.262270 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.262365 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.262608 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.262750 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.262908 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.263245 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.263339 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.263594 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.263680 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.263906 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.263990 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.264226 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.264323 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.264535 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.264653 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.264844 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.265151 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.265246 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.265458 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.265759 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.265858 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.266060 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.266315 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.266413 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.266648 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.266738 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.266966 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.267051 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.267273 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.267387 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.267616 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.267705 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.267920 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.268007 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.268233 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.268329 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.268533 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.268619 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.268841 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.268939 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.269173 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.269268 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.269502 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.269588 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.269811 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.269898 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.270128 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.270227 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.270436 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.270522 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.270745 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.270832 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.271050 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.271138 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.271406 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.271497 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.271678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.271766 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.271983 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.272071 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.272294 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.272380 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.272600 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.272686 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.272910 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.272998 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.273215 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.273301 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.273534 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.273620 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.273865 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.273955 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.274176 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.274435 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.274530 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.274769 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.275018 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.275105 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.275424 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.275627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.275730 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.276027 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.276195 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.276345 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.276652 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.276747 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.276956 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.277263 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.277363 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.277561 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.277698 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.277863 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.278166 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.278259 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.278475 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.278608 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.278779 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.278866 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.279085 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.279249 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.279403 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.279714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.279804 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.280016 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.280293 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.280381 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.280601 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.280854 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.280940 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.281209 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.281373 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.281516 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.281913 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.282096 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.282257 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.282412 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.282586 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.282713 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.282927 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.283013 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.283253 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.283346 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.283613 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.283712 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.283919 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.284004 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.284219 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.284305 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.284534 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.284655 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.284861 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.285002 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.285166 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.285261 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.285466 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.285552 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.285779 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.285866 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.286101 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.286209 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.286417 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.286549 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.286719 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.286806 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.287025 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.287120 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.287329 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.287488 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.287673 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.287760 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.287987 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.288087 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.288295 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.288382 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.288604 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.288690 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.288912 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.289000 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.289217 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.289312 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.290038 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.290130 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.290353 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.290446 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.290658 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.290743 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.290968 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.291064 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.291275 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.291411 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.291601 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.291688 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.291910 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.291995 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.292224 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.292316 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.292589 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.292789 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.292901 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.293118 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.293230 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.293432 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.293547 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.293748 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.293841 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.294085 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.294186 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.294400 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.294488 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.294729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.294814 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.295053 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.295149 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.295378 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.295479 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.295685 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.295771 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.295992 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.296103 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.296299 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.296397 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.296630 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.296714 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.296946 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.297042 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.297261 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.297347 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.297567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.297651 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.297873 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.297968 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.298186 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.298280 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.298488 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.298574 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.298792 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.298887 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.299096 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.299182 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.299427 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.299518 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.299742 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.299832 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.300046 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.300132 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.300353 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.300439 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.300655 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.300743 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.300963 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.301046 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.301266 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.301359 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.301567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.301654 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.301868 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.302141 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.302233 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.302479 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.302567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.302780 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.302864 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.303111 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.303195 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.303458 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.303548 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.303800 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.303897 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.304102 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.304189 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.304404 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.304498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.304724 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.304812 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.305038 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.305160 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.305882 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.306023 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.306183 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.306271 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.306489 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.306578 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.306793 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.306892 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.307092 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.307179 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.307435 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.307535 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.307742 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.307829 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.308051 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.308138 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.308355 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.308440 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.308650 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.308736 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.308954 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.309039 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.309253 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.309342 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.309562 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.309650 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.309864 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.309952 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.310164 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.310250 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.310463 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.310551 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.310770 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.310863 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.311074 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.311169 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.311390 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.311479 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.311699 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.311795 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.311997 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.312091 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.312309 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.312405 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.312609 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.312702 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.312909 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.313004 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.313208 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.313303 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.313512 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.313598 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.313812 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.313899 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.314109 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.314195 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.314428 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.314518 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.314734 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.314828 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.315033 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.315119 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.315332 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.315438 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.315659 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.315747 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.315958 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.316045 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.316256 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.316350 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.316561 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.316656 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.316880 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.316967 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.317191 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.317276 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.317490 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.317578 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.317794 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.317880 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.318098 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.318197 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.318397 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.318485 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.318697 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.318782 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.318999 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.319095 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.319296 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.319390 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.319619 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.319696 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.319918 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.320016 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.320217 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.320316 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.320515 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.320602 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.320855 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.320955 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.321161 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.321246 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.321460 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.321553 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.321761 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.321849 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.322059 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.322145 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.322362 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.322448 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.322674 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.322762 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.322988 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.323083 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.323296 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.323400 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.323644 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.323730 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.323959 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.324043 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.324265 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.324358 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.324571 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.324664 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.324881 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.324965 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.325185 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.325319 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.325491 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.325575 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.325794 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.325879 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.326102 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.326233 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.326403 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.326490 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.326701 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.326790 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.327018 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.327111 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.327324 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.327464 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.327652 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.327738 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.327957 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.328052 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.328269 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.328362 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.328575 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.328661 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.328877 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.328969 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.329181 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.329266 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.329484 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.329569 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.329788 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.329950 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.330090 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.330183 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.330394 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.330480 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.330699 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.330786 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.331004 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.331090 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.331305 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.331406 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.331637 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.331726 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.331942 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.332027 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.332244 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.332340 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.332549 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.332644 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.332853 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.332939 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.333154 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.333248 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.333472 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.333558 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.333777 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.333871 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.334077 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.334173 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.334384 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.334472 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.334683 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.334770 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.334988 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.335083 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.335288 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.335443 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.335659 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.335747 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.335973 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.336068 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.336325 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.336420 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.336636 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.336765 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.336942 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.337065 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.337247 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.337333 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.337557 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.337645 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.337867 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.337954 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.338174 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.338267 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.338485 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.338572 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.338801 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.338889 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.339114 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.339200 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.339451 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.339551 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.339769 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.339857 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.340065 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.340150 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.340372 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.340468 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.340690 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.340775 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.340987 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.341074 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.341288 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.341384 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.341588 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.341675 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.341901 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.341994 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.342198 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.342292 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.342507 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.342590 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.342836 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.342921 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.343153 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.343248 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.343487 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.343577 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.343806 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.343919 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.344117 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.344226 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.344433 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.344519 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.344744 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.344830 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.345144 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.345230 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.345466 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.345560 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.345768 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.345861 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.346077 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.346164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.346381 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.346475 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.346693 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.346826 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.347009 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.347094 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.347315 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.347425 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.347646 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.347746 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.347946 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.348067 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.348269 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.348387 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.348586 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.348687 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.348896 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.348990 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.349216 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.349391 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.349598 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.349685 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.349915 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.350014 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.350221 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.350307 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.350537 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.350630 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.350845 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.350942 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.351146 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.351239 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.351471 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.351561 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.351780 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.351869 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.352613 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.352709 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.352914 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.353051 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.353235 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.353369 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.353537 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.353680 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.353844 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.354102 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.354199 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.354419 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.354526 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.354738 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.354830 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.355071 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.355165 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.355422 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.355512 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.355748 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.355833 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.356064 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.356150 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.356372 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.356458 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.356685 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.356781 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.357001 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.357094 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.357301 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.357396 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.357618 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.357714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.357923 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.358011 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.358227 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.358311 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.358525 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.358609 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.358825 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.358919 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.359162 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.359249 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.359488 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.359594 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.359805 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.359916 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.360131 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.360244 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.360458 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.360555 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.360765 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.360872 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.361094 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.361202 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.361418 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.361512 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.361732 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.361827 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.362037 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.362124 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.362348 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.362443 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.362668 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.362756 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.362968 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.363054 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.363268 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.363388 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.363595 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.363681 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.363893 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.363981 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.364191 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.364280 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.364491 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.364576 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.364794 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.364881 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.365090 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.365177 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.365389 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.365476 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.365689 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.365776 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.366007 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.366107 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.366305 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.366404 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.366622 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.366716 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.366926 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.367059 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.367224 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.367311 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.367570 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.368167 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.368452 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.368537 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.368763 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.368851 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.369073 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.369168 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.369396 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.369481 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.369702 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.369788 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.370023 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.370121 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.370335 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.370422 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.370646 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.370732 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.370957 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.371046 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.371269 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.371371 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.371605 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.371694 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.371918 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.372007 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.372229 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.372361 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.372535 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.372622 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.372848 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.372936 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.373161 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.373247 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.373476 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.373561 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.373794 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.373988 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.374107 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.374314 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.374408 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.374625 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.374713 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.374933 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.375019 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.375243 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.375329 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.375577 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.375667 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.375887 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.375980 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.376196 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.376283 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.376502 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.376598 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.376809 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.376906 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.377114 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.377202 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.377440 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.377528 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.377756 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.377852 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.378063 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.378157 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.378403 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.378490 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.378713 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.378797 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.379021 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.379116 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.379333 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.379479 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.379668 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.379755 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.380001 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.380097 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.380319 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.380405 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.380623 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.380710 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.380930 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.381019 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.381240 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.381326 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.381548 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.381642 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.381856 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.381945 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.382161 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.382249 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.382469 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.382555 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.382777 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.382864 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.383083 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.383188 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.383439 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.383687 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.383775 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.384026 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.384112 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.384348 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.384436 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.384670 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.384759 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.384983 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.385075 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.385291 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.385377 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.385600 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.385696 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.385911 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.385997 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.386229 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.386430 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.386547 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.386745 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.386876 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.387077 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.387185 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.387425 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.387541 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.387751 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.387874 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.388066 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.388217 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.388386 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.388541 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.388709 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.388861 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.389011 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.389183 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.389311 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.389505 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.389617 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.389869 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.389956 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.390190 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.390284 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.390502 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.390588 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.390811 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.390896 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.391115 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.391217 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.391455 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.391546 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.391763 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.391861 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.392081 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.392286 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.392401 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.392628 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.392717 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.392943 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.393038 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.393262 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.393349 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.393583 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.393669 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.393896 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.393997 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.394198 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.394292 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.394518 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.394614 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.394823 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.394911 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.395126 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.395214 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.395464 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.395565 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.395774 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.395868 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.396075 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.396334 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.396420 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.396656 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.396743 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.396958 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.397043 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.397258 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.397340 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.397564 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.397651 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.397862 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.397949 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.398189 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.398285 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.398492 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.398585 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.398815 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.398912 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.399119 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.399215 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.399450 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.399550 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.399753 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.399847 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.400055 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.400156 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.400356 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.400444 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.400656 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.400748 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.400962 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.401123 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.401261 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.401354 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.401565 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.401652 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.401865 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.402155 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.402250 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.402507 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.402631 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.402813 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.402943 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.403113 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.403200 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.403458 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.403549 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.403761 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.403860 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.404061 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.404147 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.404372 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.404467 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.404676 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.404772 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.404992 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.405079 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.405298 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.405384 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.405604 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.405692 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.405917 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.406001 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.406231 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.406329 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.406549 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.407041 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.407125 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.407350 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.407489 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.407688 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.407786 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.408017 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.408103 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.408349 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.408435 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.408655 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.408754 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.408960 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.409046 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.409262 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.409348 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.409575 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.409661 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.409881 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.409967 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.410188 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.410279 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.410494 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.410580 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.410798 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.410927 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.411102 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.411187 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.411431 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.411520 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.411737 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.411821 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.412041 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.412144 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.412344 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.412430 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.412647 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.412777 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.412951 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.413049 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.413256 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.413351 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.413560 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.413653 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.413862 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.413961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.414170 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.414257 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.415024 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.415117 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.415337 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.415492 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.415674 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.415763 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.415990 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.416082 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.416299 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.416386 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.416605 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.416691 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.416911 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.417006 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.417218 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.417475 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.417604 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.417812 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.417900 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.418133 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.418228 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.418440 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.418526 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.418746 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.418839 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.419192 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.419440 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.419570 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.419760 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.419884 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.420080 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.420217 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.420400 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.420535 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.420709 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.420855 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.421030 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.421171 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.421354 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.421487 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.421664 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.421802 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.421981 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.422117 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.422287 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.422432 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.422615 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.422746 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.422951 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.423080 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.423277 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.423508 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.423622 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.423926 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.424027 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.424229 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.424533 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.424626 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.424840 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.425082 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.425176 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.425445 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.425628 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.425744 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.426044 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.426172 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.426346 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.426646 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.426774 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.426945 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.427244 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.427338 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.427567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.427871 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.427960 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.428168 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.428467 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.428561 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.428773 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.429000 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.429085 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.429355 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.429542 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.429636 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.429944 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.430047 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.430802 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.430968 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.431101 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.431379 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.431479 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.431706 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.431801 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.432008 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.432103 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.432337 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.432423 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.432667 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.432754 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.432978 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.433299 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.433387 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.433606 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.433692 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.433972 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.434077 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.434232 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.434320 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.434551 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.434637 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.434868 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.434964 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.435178 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.435265 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.435511 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.435647 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.435839 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.435937 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.436145 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.436232 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.436451 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.436569 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.436758 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.436918 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.437065 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.437258 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.437370 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.437593 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.437688 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.437907 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.437993 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.438221 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.438308 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.438537 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.438637 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.438856 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.438942 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.439183 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.439276 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.439522 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.439626 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.439832 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.439916 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.440136 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.440222 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.440449 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.440535 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.440755 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.440839 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.441062 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.441186 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.441367 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.441455 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.441673 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.441796 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.441980 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.442068 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.442287 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.442373 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.442589 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.442676 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.442895 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.442987 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.443204 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.443290 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.443535 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.443622 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.443844 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.443944 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.444160 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.444247 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.444465 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.444551 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.444771 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.444864 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.445080 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.445174 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.445388 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.445475 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.445724 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.445822 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.446062 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.446155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.446397 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.446482 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.446705 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.446799 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.447012 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.447100 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.447311 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.447471 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.447566 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 06:28:54.447675 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.447992 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.448321 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.448650 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.448969 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.449285 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.449625 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.449943 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.450261 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.450580 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.450898 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.451213 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.451555 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.451891 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.452225 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.452537 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.452867 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.453187 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.453510 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.453830 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.454147 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.454480 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.454797 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.455112 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.455450 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.455769 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.456085 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.456412 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.456727 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.457043 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.457365 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.457686 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.458018 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.458360 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.458679 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.459012 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.459344 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.459719 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.460038 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.460387 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.460724 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.461043 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.461389 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.461697 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:28:54.461945 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 06:28:54.600090 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO dbcounter [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Registered counter for database nova_api Sep 13 06:28:54.613612 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO dbcounter [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Registered counter for database nova_api Sep 13 06:28:54.622326 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_db.sqlalchemy.engines [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:28:54.628997 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writer thread running {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:28:54.633994 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG oslo_db.sqlalchemy.engines [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:28:54.640460 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writer thread running {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:28:54.687680 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.context [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5983513-f545-4028-b6c7-d14599d1f916(cell1) {{(pid=105771) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 06:28:54.691575 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:28:54.692044 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:28:54.693592 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:28:54.694305 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:28:54.694756 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:28:54.696771 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:28:54.698508 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.context [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5983513-f545-4028-b6c7-d14599d1f916(cell1) {{(pid=105772) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 06:28:54.698732 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO dbcounter [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Registered counter for database nova_cell0 Sep 13 06:28:54.702366 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG oslo_concurrency.lockutils [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:28:54.702770 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO dbcounter [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Registered counter for database nova_cell1 Sep 13 06:28:54.702864 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG oslo_concurrency.lockutils [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:28:54.704412 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG oslo_concurrency.lockutils [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:28:54.705149 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG oslo_concurrency.lockutils [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:28:54.705599 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG oslo_concurrency.lockutils [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:28:54.707605 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG oslo_concurrency.lockutils [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:28:54.709642 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO dbcounter [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Registered counter for database nova_cell0 Sep 13 06:28:54.709767 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_db.sqlalchemy.engines [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:28:54.712398 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_db.sqlalchemy.engines [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:28:54.714337 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO dbcounter [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Registered counter for database nova_cell1 Sep 13 06:28:54.717436 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writer thread running {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:28:54.722612 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writer thread running {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:28:54.723391 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG oslo_db.sqlalchemy.engines [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:28:54.725031 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG oslo_db.sqlalchemy.engines [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:28:54.731154 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writer thread running {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:28:54.736411 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writer thread running {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:28:54.864656 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO dbcounter [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Registered counter for database nova_cell0 Sep 13 06:28:54.873301 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_db.sqlalchemy.engines [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:28:54.878490 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writer thread running {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:28:54.878986 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO dbcounter [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Registered counter for database nova_cell0 Sep 13 06:28:54.885775 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG oslo_db.sqlalchemy.engines [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:28:54.890608 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writer thread running {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:28:55.213107 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: WARNING keystonemiddleware.auth_token [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:28:55.220348 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: WARNING keystonemiddleware.auth_token [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:28:55.221137 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: WARNING keystonemiddleware.auth_token [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:28:55.229010 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: WARNING keystonemiddleware.auth_token [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:28:55.561130 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: WARNING keystonemiddleware.auth_token [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:28:55.567000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: WARNING keystonemiddleware.auth_token [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:28:55.572349 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1fba719c0 pid: 105771 (default app) Sep 13 06:28:55.574411 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:28:55.575256 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: WARNING keystonemiddleware.auth_token [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:28:55.575609 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001717 Sep 13 06:28:55.576029 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Tue Sep 13 06:28:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:28:55.581279 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: WARNING keystonemiddleware.auth_token [None req-ca64e3cb-608d-4aae-be8f-3c07241deabb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:28:55.587141 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1fba719c0 pid: 105772 (default app) Sep 13 06:30:15.970948 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:15.972038 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 13 06:30:15.972438 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:15.991390 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writing DB stats nova_api:SELECT=3 {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:15.992636 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writing DB stats nova_cell1:SELECT=3 {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:15.993386 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writing DB stats nova_cell0:SELECT=3 {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:15.994083 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:16.873622 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-613a3cd0-5d85-4129-be94-0026c42600bf admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:16.906484 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-613a3cd0-5d85-4129-be94-0026c42600bf admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925853 Sep 13 06:30:16.907410 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Sep 13 06:30:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:30:19.505151 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:19.506277 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-7191fb25-3753-4d65-b855-76d5f6f5b8e3 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 13 06:30:19.506906 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:19.984331 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-604ab80d-341f-456f-9dba-023a7f3ad37a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:20.032105 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-604ab80d-341f-456f-9dba-023a7f3ad37a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.519115 Sep 13 06:30:20.032594 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Sep 13 06:30:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:30:20.045922 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writing DB stats nova_api:SELECT=3 {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:20.046735 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writing DB stats nova_cell0:SELECT=3 {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:20.049630 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writing DB stats nova_cell1:SELECT=3 {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:20.050404 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:20.257154 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-c795f3c4-3d53-4149-aba3-0cf2e96e2f82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:20.325620 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-c795f3c4-3d53-4149-aba3-0cf2e96e2f82 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284702 Sep 13 06:30:20.326277 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Sep 13 06:30:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:30:22.951315 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-604ab80d-341f-456f-9dba-023a7f3ad37a admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:22.952393 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-604ab80d-341f-456f-9dba-023a7f3ad37a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 13 06:30:22.952808 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:23.645870 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-c20ccecf-f903-44f5-a49d-6984ee66d420 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:23.686250 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-c20ccecf-f903-44f5-a49d-6984ee66d420 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.727046 Sep 13 06:30:23.686828 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Sep 13 06:30:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:30:23.698623 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-e5bf924a-4b88-49d9-b356-19ecce21ff38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:23.743951 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-e5bf924a-4b88-49d9-b356-19ecce21ff38 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048872 Sep 13 06:30:23.744882 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Sep 13 06:30:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:30:26.340804 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-c20ccecf-f903-44f5-a49d-6984ee66d420 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:26.341832 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-c20ccecf-f903-44f5-a49d-6984ee66d420 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 13 06:30:26.342241 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:26.774506 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-a0f10afd-a03f-4da9-a689-5b414dbdb0ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:26.794216 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-a0f10afd-a03f-4da9-a689-5b414dbdb0ee admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445355 Sep 13 06:30:26.794775 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Sep 13 06:30:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 06:30:26.807671 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-d3cd6c7e-99ca-454c-933f-4485bf60fc09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:26.837868 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-d3cd6c7e-99ca-454c-933f-4485bf60fc09 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033755 Sep 13 06:30:26.838365 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Sep 13 06:30:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:30:29.572672 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-a0f10afd-a03f-4da9-a689-5b414dbdb0ee admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:29.574394 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-a0f10afd-a03f-4da9-a689-5b414dbdb0ee admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Sep 13 06:30:29.578490 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:30.047160 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-ff7d10b4-949b-4ca1-abcd-1cd21a949dc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:30.069194 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-ff7d10b4-949b-4ca1-abcd-1cd21a949dc4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488074 Sep 13 06:30:30.069969 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Sep 13 06:30:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:30:30.082451 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-5b518d39-8ce3-4936-a916-095cc901ea12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:30.113104 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-5b518d39-8ce3-4936-a916-095cc901ea12 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034803 Sep 13 06:30:30.114023 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Sep 13 06:30:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:30:32.939239 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-ff7d10b4-949b-4ca1-abcd-1cd21a949dc4 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:32.940296 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-ff7d10b4-949b-4ca1-abcd-1cd21a949dc4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 13 06:30:32.940896 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:33.389435 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-6f5db942-e43d-4a4f-b4d0-e60ec90e0cd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20}} {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:33.411624 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-6f5db942-e43d-4a4f-b4d0-e60ec90e0cd8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464379 Sep 13 06:30:33.412205 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Sep 13 06:30:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:30:33.424416 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-ffc995f6-377b-4347-9502-6c6e08f01a0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:33.452258 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-ffc995f6-377b-4347-9502-6c6e08f01a0b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031536 Sep 13 06:30:33.452802 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Sep 13 06:30:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:30:36.281184 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-6f5db942-e43d-4a4f-b4d0-e60ec90e0cd8 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:36.282322 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-6f5db942-e43d-4a4f-b4d0-e60ec90e0cd8 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001888 Sep 13 06:30:36.282911 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:36.729568 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-a63ab707-a6ca-4b85-a639-f8d349f4e198 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:36.757475 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-a63ab707-a6ca-4b85-a639-f8d349f4e198 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.467602 Sep 13 06:30:36.759387 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Sep 13 06:30:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:30:39.459103 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-6f5db942-e43d-4a4f-b4d0-e60ec90e0cd8 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:39.460280 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-6f5db942-e43d-4a4f-b4d0-e60ec90e0cd8 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Sep 13 06:30:39.460719 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:39.875005 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-dfc8525e-ae54-448a-b0dd-d475590e31af admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:39.893709 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-dfc8525e-ae54-448a-b0dd-d475590e31af admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.426969 Sep 13 06:30:39.894761 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Sep 13 06:30:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:30:39.908624 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-1e30e53d-87eb-4c82-92c4-fa1309c26457 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:39.942299 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-1e30e53d-87eb-4c82-92c4-fa1309c26457 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038692 Sep 13 06:30:39.947376 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Sep 13 06:30:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:30:42.532888 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-dfc8525e-ae54-448a-b0dd-d475590e31af admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:42.533902 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-dfc8525e-ae54-448a-b0dd-d475590e31af admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 13 06:30:42.534315 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:42.937606 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-056eca8d-a513-417d-9ec9-2c8e51e674f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:42.957707 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-056eca8d-a513-417d-9ec9-2c8e51e674f1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416967 Sep 13 06:30:42.958250 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Sep 13 06:30:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:30:42.969976 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-586ad052-fb1a-4cae-b0b7-8aada50fc4a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:42.993880 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-586ad052-fb1a-4cae-b0b7-8aada50fc4a6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027471 Sep 13 06:30:42.994448 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Sep 13 06:30:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:30:45.567060 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-056eca8d-a513-417d-9ec9-2c8e51e674f1 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:45.568021 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-056eca8d-a513-417d-9ec9-2c8e51e674f1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Sep 13 06:30:45.568446 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:45.962359 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-9f523168-ede7-44cb-9894-19476b5d1551 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium"}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:45.985125 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-9f523168-ede7-44cb-9894-19476b5d1551 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.409828 Sep 13 06:30:45.985687 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Sep 13 06:30:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 06:30:45.998000 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-cc6f6da6-13a4-4202-a21b-b332113efafd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:46.022913 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:46.026945 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-cc6f6da6-13a4-4202-a21b-b332113efafd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032751 Sep 13 06:30:46.027560 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Sep 13 06:30:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:30:48.685190 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-9f523168-ede7-44cb-9894-19476b5d1551 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:48.686220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-9f523168-ede7-44cb-9894-19476b5d1551 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 13 06:30:48.686621 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:49.122820 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-f54b3256-475c-4d3d-9682-15c9237139d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:49.143101 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-f54b3256-475c-4d3d-9682-15c9237139d7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450442 Sep 13 06:30:49.143784 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Sep 13 06:30:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:30:49.156777 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-bb674b76-0e39-4b91-9602-a3f70beaf255 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:49.181455 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-bb674b76-0e39-4b91-9602-a3f70beaf255 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028647 Sep 13 06:30:49.182310 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Sep 13 06:30:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:30:51.794192 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-f54b3256-475c-4d3d-9682-15c9237139d7 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:30:51.795193 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-f54b3256-475c-4d3d-9682-15c9237139d7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 13 06:30:51.795813 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:30:52.302538 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-46b4501f-1d52-4d91-8c8e-381efa097ee9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:52.310222 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:52.325574 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-46b4501f-1d52-4d91-8c8e-381efa097ee9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.523785 Sep 13 06:30:52.326585 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Sep 13 06:30:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 06:30:52.339883 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-22ce46f4-afec-4b2c-a4e6-b2f862c817b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:30:52.368545 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-22ce46f4-afec-4b2c-a4e6-b2f862c817b1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032285 Sep 13 06:30:52.379449 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Sep 13 06:30:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:31:12.901286 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-46b4501f-1d52-4d91-8c8e-381efa097ee9 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:12.902219 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-46b4501f-1d52-4d91-8c8e-381efa097ee9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 13 06:31:12.902630 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:31:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:31:12.913497 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=2,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:13.283697 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-9b0c4b3a-c16a-4840-b00b-44b9c3537107 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:13.302449 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-9b0c4b3a-c16a-4840-b00b-44b9c3537107 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.393445 Sep 13 06:31:13.302983 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Sep 13 06:31:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:31:14.593979 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-46b4501f-1d52-4d91-8c8e-381efa097ee9 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:14.594996 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-46b4501f-1d52-4d91-8c8e-381efa097ee9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 13 06:31:14.595434 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:31:15.108378 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-626c8033-c458-4025-bd0e-3850cf04643c admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:15.113834 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.wsgi [None req-626c8033-c458-4025-bd0e-3850cf04643c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-626c8033-c458-4025-bd0e-3850cf04643c admin admin] Request method failure captured: Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Accept: application/json Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Accept-Encoding: gzip, deflate Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Connection: keep-alive Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Content-Length: 0 Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Host: 10.222.0.17 Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Openstack-Api-Version: compute 2.92 Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Openstack-System-Scope: None Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: User-Agent: python-novaclient Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Auth-Token: gAAAAABjICOyFeh-r4zcf2EuzqsVam0hG6F336dfJPUJd4Su2APRAiA2zZoEmH3580dY7TOb35Fs0y9i3T6gV1pe5o37az8dHq8vobCGLileF9F2wxDsl-zMIV3hY-sn6sFvqbZ5evWJn6HE3i5RnUeJsmxhvo4qttTaudGpU7iMx6X4MjXQ_xQ Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Domain-Id: None Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Domain-Name: None Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Identity-Status: Confirmed Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Is-Admin-Project: True Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Domain-Id: default Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Domain-Name: Default Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Name: admin Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Role: reader,member,admin Sep 13 06:31:15.117041 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Roles: reader,member,admin Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Tenant: admin Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Tenant-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Tenant-Name: admin Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User: admin Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Domain-Id: default Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Domain-Name: Default Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Id: 0bb6c0629d15437caa17023bc8a8da59 Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Name: admin Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: method: > Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: exception: Flavor 42 could not be found. Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: action_args: {'id': '42'} Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:31:15.118714 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:15.119781 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:15.121164 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-626c8033-c458-4025-bd0e-3850cf04643c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:31:15.122514 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-626c8033-c458-4025-bd0e-3850cf04643c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388023 Sep 13 06:31:15.122514 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Sep 13 06:31:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:15.128049 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-cd9bb71d-411e-4d7e-baab-a59bf8e112db admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:15.151117 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-cd9bb71d-411e-4d7e-baab-a59bf8e112db admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026588 Sep 13 06:31:15.151697 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Sep 13 06:31:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:31:15.162889 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-4779962d-f082-421e-a75f-bec6c95dadca admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:15.184766 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-4779962d-f082-421e-a75f-bec6c95dadca admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027094 Sep 13 06:31:15.185300 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Sep 13 06:31:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:31:15.194893 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-081cdd49-1f0f-4219-ae22-35ee0f5fe5c1 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:15.200029 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.wsgi [None req-081cdd49-1f0f-4219-ae22-35ee0f5fe5c1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-081cdd49-1f0f-4219-ae22-35ee0f5fe5c1 admin admin] Request method failure captured: Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Accept: application/json Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Accept-Encoding: gzip, deflate Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Connection: keep-alive Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Content-Length: 0 Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Host: 10.222.0.17 Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Openstack-Api-Version: compute 2.92 Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Openstack-System-Scope: None Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: User-Agent: python-novaclient Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Auth-Token: gAAAAABjICOyFeh-r4zcf2EuzqsVam0hG6F336dfJPUJd4Su2APRAiA2zZoEmH3580dY7TOb35Fs0y9i3T6gV1pe5o37az8dHq8vobCGLileF9F2wxDsl-zMIV3hY-sn6sFvqbZ5evWJn6HE3i5RnUeJsmxhvo4qttTaudGpU7iMx6X4MjXQ_xQ Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Domain-Id: None Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Domain-Name: None Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Identity-Status: Confirmed Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Is-Admin-Project: True Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Domain-Id: default Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Domain-Name: Default Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Name: admin Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Role: reader,member,admin Sep 13 06:31:15.203220 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Roles: reader,member,admin Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Tenant: admin Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Tenant-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Tenant-Name: admin Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User: admin Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Domain-Id: default Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Domain-Name: Default Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Id: 0bb6c0629d15437caa17023bc8a8da59 Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Name: admin Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: method: > Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: exception: Flavor 42 could not be found. Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: action_args: {'id': '42'} Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:31:15.204663 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:15.210103 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:15.211405 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-081cdd49-1f0f-4219-ae22-35ee0f5fe5c1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:31:15.212647 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-081cdd49-1f0f-4219-ae22-35ee0f5fe5c1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013493 Sep 13 06:31:15.212647 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Sep 13 06:31:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:16.413646 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-4779962d-f082-421e-a75f-bec6c95dadca admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:16.414663 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-4779962d-f082-421e-a75f-bec6c95dadca admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 13 06:31:16.415067 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:31:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:31:16.934370 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-04a1f50d-83f7-4b4d-b538-21e7dfa390d8 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:16.939274 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.wsgi [None req-04a1f50d-83f7-4b4d-b538-21e7dfa390d8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-04a1f50d-83f7-4b4d-b538-21e7dfa390d8 admin admin] Request method failure captured: Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Accept: application/json Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Accept-Encoding: gzip, deflate Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Connection: keep-alive Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Content-Length: 0 Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Host: 10.222.0.17 Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Openstack-Api-Version: compute 2.92 Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Openstack-System-Scope: None Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: User-Agent: python-novaclient Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Auth-Token: gAAAAABjICO0JZUsmHdzeLgq-JOMExG6rzFS-zTdrZQiIrrnxLwfQmfSQPu8BEEiADHNdNswEVfORkWX861wRK8O7LyZONVol_c9yoigG3JweerQCctBiuRYkajs2UV7HdjVmeO9z75p3Yy-3we8i1lgMMx4l9tvbzYFjc7_OLP01maE055Itlo Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Domain-Id: None Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Domain-Name: None Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Identity-Status: Confirmed Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Is-Admin-Project: True Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Domain-Id: default Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Domain-Name: Default Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Name: admin Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Role: reader,member,admin Sep 13 06:31:16.940790 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Roles: reader,member,admin Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Tenant: admin Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Tenant-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Tenant-Name: admin Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User: admin Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Domain-Id: default Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Domain-Name: Default Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Id: 0bb6c0629d15437caa17023bc8a8da59 Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Name: admin Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: method: > Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: exception: Flavor 84 could not be found. Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: action_args: {'id': '84'} Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:31:16.942678 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:16.943509 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:16.944567 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-04a1f50d-83f7-4b4d-b538-21e7dfa390d8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:31:16.945548 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-04a1f50d-83f7-4b4d-b538-21e7dfa390d8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389264 Sep 13 06:31:16.945548 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Sep 13 06:31:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:16.952375 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-fd818e03-4afd-420a-bc8a-7d79b1110518 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:16.967510 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-fd818e03-4afd-420a-bc8a-7d79b1110518 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018627 Sep 13 06:31:16.968024 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Sep 13 06:31:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:31:16.977041 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-67d7f2d8-34eb-435a-b183-2e8babd42ad3 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:16.992434 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-67d7f2d8-34eb-435a-b183-2e8babd42ad3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018914 Sep 13 06:31:16.992963 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Sep 13 06:31:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:31:17.002004 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-8b27b075-30d6-4de8-a6a6-cabd37cfc4cc admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:17.007432 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.wsgi [None req-8b27b075-30d6-4de8-a6a6-cabd37cfc4cc admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-8b27b075-30d6-4de8-a6a6-cabd37cfc4cc admin admin] Request method failure captured: Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Accept: application/json Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Accept-Encoding: gzip, deflate Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Connection: keep-alive Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Content-Length: 0 Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Host: 10.222.0.17 Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Openstack-Api-Version: compute 2.92 Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Openstack-System-Scope: None Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: User-Agent: python-novaclient Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Auth-Token: gAAAAABjICO0JZUsmHdzeLgq-JOMExG6rzFS-zTdrZQiIrrnxLwfQmfSQPu8BEEiADHNdNswEVfORkWX861wRK8O7LyZONVol_c9yoigG3JweerQCctBiuRYkajs2UV7HdjVmeO9z75p3Yy-3we8i1lgMMx4l9tvbzYFjc7_OLP01maE055Itlo Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Domain-Id: None Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Domain-Name: None Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Identity-Status: Confirmed Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Is-Admin-Project: True Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Domain-Id: default Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Domain-Name: Default Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Name: admin Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Role: reader,member,admin Sep 13 06:31:17.008922 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Roles: reader,member,admin Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Tenant: admin Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Tenant-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Tenant-Name: admin Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User: admin Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Domain-Id: default Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Domain-Name: Default Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Id: 0bb6c0629d15437caa17023bc8a8da59 Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Name: admin Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: method: > Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: exception: Flavor 84 could not be found. Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: action_args: {'id': '84'} Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:31:17.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:17.011511 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:17.012924 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-8b27b075-30d6-4de8-a6a6-cabd37cfc4cc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:31:17.014217 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-8b27b075-30d6-4de8-a6a6-cabd37cfc4cc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011768 Sep 13 06:31:17.014217 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Sep 13 06:31:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:18.237498 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-67d7f2d8-34eb-435a-b183-2e8babd42ad3 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:18.239117 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-67d7f2d8-34eb-435a-b183-2e8babd42ad3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 13 06:31:18.239551 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:31:18.760723 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-1bdfc512-ab4f-4a9d-82e0-c54e8f2995dc admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:18.766431 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.wsgi [None req-1bdfc512-ab4f-4a9d-82e0-c54e8f2995dc admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-1bdfc512-ab4f-4a9d-82e0-c54e8f2995dc admin admin] Request method failure captured: Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Accept: application/json Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Accept-Encoding: gzip, deflate Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Connection: keep-alive Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Content-Length: 0 Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Host: 10.222.0.17 Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Openstack-Api-Version: compute 2.92 Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Openstack-System-Scope: None Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: User-Agent: python-novaclient Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Auth-Token: gAAAAABjICO2oaR_OTOoBvBga3-O8lTgQKqWyW0sAwoRX1fVnfHUgo61NBVG_0F0NMsM-eG6kX9nh8kZsx15X3oUbnW1OuBBiDtFfJRb5NQkZChFUzAt2SiPbu-WWbwPv3hZFW79QVOzCKU9vPXL8WT_fzQ9xuxjk_lppwMuRTGtPCtN-5to4BY Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Domain-Id: None Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Domain-Name: None Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Identity-Status: Confirmed Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Is-Admin-Project: True Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Domain-Id: default Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Domain-Name: Default Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Project-Name: admin Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Role: reader,member,admin Sep 13 06:31:18.767962 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Roles: reader,member,admin Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Tenant: admin Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Tenant-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-Tenant-Name: admin Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User: admin Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Domain-Id: default Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Domain-Name: Default Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Id: 0bb6c0629d15437caa17023bc8a8da59 Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: X-User-Name: admin Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: method: > Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: exception: Flavor 451 could not be found. Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: action_args: {'id': '451'} Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:31:18.769638 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:18.770627 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: ERROR nova.api.openstack.wsgi Sep 13 06:31:18.771961 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-1bdfc512-ab4f-4a9d-82e0-c54e8f2995dc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:31:18.773199 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-1bdfc512-ab4f-4a9d-82e0-c54e8f2995dc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393478 Sep 13 06:31:18.773199 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Sep 13 06:31:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:18.779043 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-c53c2d68-92c7-4a77-8b84-0a5eabbc30d7 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:18.793998 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-c53c2d68-92c7-4a77-8b84-0a5eabbc30d7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018518 Sep 13 06:31:18.794532 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Sep 13 06:31:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:31:18.803990 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:18.819076 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019022 Sep 13 06:31:18.819640 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Sep 13 06:31:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:31:18.828749 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-cbb47825-6fcf-442a-9b68-1e976db88df9 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:18.833665 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.wsgi [None req-cbb47825-6fcf-442a-9b68-1e976db88df9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-cbb47825-6fcf-442a-9b68-1e976db88df9 admin admin] Request method failure captured: Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Accept: application/json Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Accept-Encoding: gzip, deflate Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Connection: keep-alive Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Content-Length: 0 Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Host: 10.222.0.17 Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Openstack-Api-Version: compute 2.92 Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Openstack-System-Scope: None Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: User-Agent: python-novaclient Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Auth-Token: gAAAAABjICO2oaR_OTOoBvBga3-O8lTgQKqWyW0sAwoRX1fVnfHUgo61NBVG_0F0NMsM-eG6kX9nh8kZsx15X3oUbnW1OuBBiDtFfJRb5NQkZChFUzAt2SiPbu-WWbwPv3hZFW79QVOzCKU9vPXL8WT_fzQ9xuxjk_lppwMuRTGtPCtN-5to4BY Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Domain-Id: None Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Domain-Name: None Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Identity-Status: Confirmed Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Is-Admin-Project: True Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Domain-Id: default Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Domain-Name: Default Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Project-Name: admin Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Role: reader,member,admin Sep 13 06:31:18.835155 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Roles: reader,member,admin Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4695a0e69c164c22b1c8ba0d16876ae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Tenant: admin Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Tenant-Id: 4695a0e69c164c22b1c8ba0d16876ae8 Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-Tenant-Name: admin Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User: admin Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Domain-Id: default Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Domain-Name: Default Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Id: 0bb6c0629d15437caa17023bc8a8da59 Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: X-User-Name: admin Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: method: > Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: exception: Flavor 451 could not be found. Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: action_args: {'id': '451'} Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:31:18.836729 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:18.837721 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: ERROR nova.api.openstack.wsgi Sep 13 06:31:18.839000 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-cbb47825-6fcf-442a-9b68-1e976db88df9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:31:18.840338 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-cbb47825-6fcf-442a-9b68-1e976db88df9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011338 Sep 13 06:31:18.840338 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Sep 13 06:31:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:20.072360 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:20.073372 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 13 06:31:20.073768 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:31:20.589114 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-9351c6bd-adb3-472b-8cc6-b3e66e359beb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:31:20.611273 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-9351c6bd-adb3-472b-8cc6-b3e66e359beb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.401265 Sep 13 06:31:20.611876 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Sep 13 06:31:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:31:21.932056 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:21.933067 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 13 06:31:21.933466 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:31:22.445791 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-8efc43ca-ebda-4951-a8c2-4b53a691216f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:31:22.464057 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-8efc43ca-ebda-4951-a8c2-4b53a691216f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.395503 Sep 13 06:31:22.464605 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Sep 13 06:31:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:31:23.692592 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:23.693744 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Sep 13 06:31:23.694229 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:31:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:31:24.208988 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-56aed6d7-d1f5-4dc2-85d8-f3f1b7508bad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:31:24.228183 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-56aed6d7-d1f5-4dc2-85d8-f3f1b7508bad admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.395567 Sep 13 06:31:24.228649 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Sep 13 06:31:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:31:25.467156 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:25.468202 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 13 06:31:25.468635 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:31:25.984973 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-443ec3f8-0566-498d-bf36-2ebd411fda3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:31:26.003161 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-443ec3f8-0566-498d-bf36-2ebd411fda3f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397835 Sep 13 06:31:26.003750 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Sep 13 06:31:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:31:27.242657 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:27.243893 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Sep 13 06:31:27.244292 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:31:27.774596 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-895815b8-7f82-4d8b-9a5e-a41ccfc5ae13 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:31:27.795292 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-895815b8-7f82-4d8b-9a5e-a41ccfc5ae13 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.412780 Sep 13 06:31:27.795851 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Tue Sep 13 06:31:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:32:24.968807 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:32:24.969860 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-20241184-25c3-4bed-a4c0-3118570496e5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 13 06:32:24.970271 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 931 bytes} [Tue Sep 13 06:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:32:24.981294 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:25.363606 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-b4548f48-57d1-4edb-870c-7bb514b69463 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:32:25.384784 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-b4548f48-57d1-4edb-870c-7bb514b69463 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407848 Sep 13 06:32:25.385335 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Sep 13 06:32:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:32:25.408603 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writing DB stats nova_api:SELECT=14 {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:25.412941 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-30963277-8995-4647-a5a3-429247f812b2 admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:32:25.420245 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-30963277-8995-4647-a5a3-429247f812b2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013518 Sep 13 06:32:25.420761 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1283 bytes} [Tue Sep 13 06:32:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:32:25.432259 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-6afce372-7578-42c7-9e6f-f76f6f7a1e98 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:32:25.439398 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-6afce372-7578-42c7-9e6f-f76f6f7a1e98 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010684 Sep 13 06:32:25.439906 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1286 bytes} [Tue Sep 13 06:32:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:32:25.451437 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-33cdeb41-f1e0-4284-bd43-1dfa932677ad admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:32:25.459030 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-33cdeb41-f1e0-4284-bd43-1dfa932677ad admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011081 Sep 13 06:32:25.459573 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1286 bytes} [Tue Sep 13 06:32:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:32:25.470498 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-be338202-ac1f-45d7-9523-bbafb6302fd7 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:32:25.477441 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-be338202-ac1f-45d7-9523-bbafb6302fd7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010345 Sep 13 06:32:25.477948 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1283 bytes} [Tue Sep 13 06:32:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:35:22.505824 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-33cdeb41-f1e0-4284-bd43-1dfa932677ad admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:35:22.506853 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-33cdeb41-f1e0-4284-bd43-1dfa932677ad admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 13 06:35:22.507282 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:35:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:35:22.645839 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writing DB stats nova_api:SELECT=6 {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:35:22.800673 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-df7633d0-6ae4-4628-afb5-8588912af636 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:35:22.805368 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-df7633d0-6ae4-4628-afb5-8588912af636 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:35:22.805845 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-df7633d0-6ae4-4628-afb5-8588912af636 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:35:22.806269 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-df7633d0-6ae4-4628-afb5-8588912af636 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:35:22.806978 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-df7633d0-6ae4-4628-afb5-8588912af636 admin admin] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:35:22.807455 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-df7633d0-6ae4-4628-afb5-8588912af636 admin admin] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:35:22.807877 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-df7633d0-6ae4-4628-afb5-8588912af636 admin admin] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:35:22.840334 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-df7633d0-6ae4-4628-afb5-8588912af636 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.195493 Sep 13 06:35:22.840875 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Sep 13 06:35:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:35:23.906856 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-33cdeb41-f1e0-4284-bd43-1dfa932677ad admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:35:23.908515 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-33cdeb41-f1e0-4284-bd43-1dfa932677ad admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Sep 13 06:35:23.908940 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:35:24.106873 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-a734c745-20f8-497f-b37a-c9d71d249046 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:35:24.110344 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-a734c745-20f8-497f-b37a-c9d71d249046 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:35:24.110866 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-a734c745-20f8-497f-b37a-c9d71d249046 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:35:24.111294 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-a734c745-20f8-497f-b37a-c9d71d249046 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:35:24.112059 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-a734c745-20f8-497f-b37a-c9d71d249046 admin admin] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:35:24.112504 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-a734c745-20f8-497f-b37a-c9d71d249046 admin admin] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:35:24.112918 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-a734c745-20f8-497f-b37a-c9d71d249046 admin admin] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:35:24.131962 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-a734c745-20f8-497f-b37a-c9d71d249046 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.085912 Sep 13 06:35:24.132453 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Sep 13 06:35:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:35:35.581060 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-33cdeb41-f1e0-4284-bd43-1dfa932677ad admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:35:35.582167 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-33cdeb41-f1e0-4284-bd43-1dfa932677ad admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 13 06:35:35.582648 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:35:35.727031 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writing DB stats nova_cell0:SELECT=4 {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:35:35.727686 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writing DB stats nova_cell1:SELECT=4 {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:35:35.728276 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG dbcounter [-] [105771] Writing DB stats nova_api:SELECT=8 {{(pid=105771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:35:35.775861 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-117ed0c7-cbe6-46eb-8487-f6ef7e176729 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:35:35.779209 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-117ed0c7-cbe6-46eb-8487-f6ef7e176729 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:35:35.779722 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-117ed0c7-cbe6-46eb-8487-f6ef7e176729 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:35:35.780175 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-117ed0c7-cbe6-46eb-8487-f6ef7e176729 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:35:35.780876 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-117ed0c7-cbe6-46eb-8487-f6ef7e176729 admin admin] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:35:35.781317 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-117ed0c7-cbe6-46eb-8487-f6ef7e176729 admin admin] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:35:35.781725 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-117ed0c7-cbe6-46eb-8487-f6ef7e176729 admin admin] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:35:35.806099 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-117ed0c7-cbe6-46eb-8487-f6ef7e176729 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.083565 Sep 13 06:35:35.806632 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Sep 13 06:35:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:35:36.871016 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG nova.api.openstack.wsgi [None req-33cdeb41-f1e0-4284-bd43-1dfa932677ad admin admin] Calling method '>' {{(pid=105772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:35:36.872078 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: INFO nova.api.openstack.requestlog [None req-33cdeb41-f1e0-4284-bd43-1dfa932677ad admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 13 06:35:36.872481 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: [pid: 105772|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Sep 13 06:35:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:35:37.059658 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG nova.api.openstack.wsgi [None req-b21a721a-0e32-42ca-82da-d015d80328c7 admin admin] Calling method '>' {{(pid=105771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:35:37.063071 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-b21a721a-0e32-42ca-82da-d015d80328c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:35:37.064097 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-b21a721a-0e32-42ca-82da-d015d80328c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:35:37.064520 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-b21a721a-0e32-42ca-82da-d015d80328c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:35:37.065230 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-b21a721a-0e32-42ca-82da-d015d80328c7 admin admin] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:35:37.065760 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-b21a721a-0e32-42ca-82da-d015d80328c7 admin admin] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:35:37.066177 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: DEBUG oslo_concurrency.lockutils [None req-b21a721a-0e32-42ca-82da-d015d80328c7 admin admin] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:35:37.087778 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: INFO nova.api.openstack.requestlog [None req-b21a721a-0e32-42ca-82da-d015d80328c7 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.078149 Sep 13 06:35:37.088259 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: [pid: 105771|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Sep 13 06:35:37 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:36:35.986044 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: Tue Sep 13 06:36:35 2022 - graceful shutdown triggered... Sep 13 06:36:35.986569 dv-cinder-856385-1-iscsi devstack@n-api.service[105771]: Gracefully killing worker 1 (pid: 105771)... Sep 13 06:36:35.987462 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: Gracefully killing worker 2 (pid: 105772)... Sep 13 06:36:35.988315 dv-cinder-856385-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 06:36:36.121205 dv-cinder-856385-1-iscsi devstack@n-api.service[105772]: DEBUG dbcounter [-] [105772] Writing DB stats nova_api:SELECT=4 {{(pid=105772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:36:36.985539 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: worker 1 buried after 1 seconds Sep 13 06:36:36.985755 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: worker 2 buried after 1 seconds Sep 13 06:36:36.985755 dv-cinder-856385-1-iscsi devstack@n-api.service[105770]: goodbye to uWSGI. Sep 13 06:36:36.987165 dv-cinder-856385-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 06:36:36.987744 dv-cinder-856385-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 06:36:36.990565 dv-cinder-856385-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 06:36:37.000299 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 06:36:37.003377 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 06:36:36 2022] *** Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: nodename: dv-cinder-856385-1-iscsi Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: machine: x86_64 Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: clock source: unix Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: pcre jit disabled Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: detected number of CPU cores: 4 Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: current working directory: / Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: detected binary path: /usr/bin/uwsgi-core Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: your processes number limit is 47680 Sep 13 06:36:37.003559 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: your memory page size is 4096 bytes Sep 13 06:36:37.004269 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: detected max file descriptor number: 2048 Sep 13 06:36:37.004269 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: lock engine: pthread robust mutexes Sep 13 06:36:37.004269 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: thunder lock: enabled Sep 13 06:36:37.004269 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 06:36:37.004269 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 06:36:37.045474 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: Python main interpreter initialized at 0x5641cce0f9c0 Sep 13 06:36:37.045474 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: python threads support enabled Sep 13 06:36:37.045474 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: your server socket listen backlog is limited to 100 connections Sep 13 06:36:37.045474 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: your mercy for graceful operations on workers is 90 seconds Sep 13 06:36:37.045921 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 06:36:37.045921 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: *** Operational MODE: preforking *** Sep 13 06:36:37.046209 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: *** uWSGI is running in multiple interpreter mode *** Sep 13 06:36:37.046209 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: spawned uWSGI master process (pid: 132378) Sep 13 06:36:37.046413 dv-cinder-856385-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 06:36:37.047116 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: spawned uWSGI worker 1 (pid: 132398, cores: 1) Sep 13 06:36:37.047610 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: spawned uWSGI worker 2 (pid: 132399, cores: 1) Sep 13 06:36:37.047610 dv-cinder-856385-1-iscsi devstack@n-api.service[132378]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 06:36:37.713046 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 06:36:37.718096 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 06:36:38.888305 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:36:38.888305 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: from cryptography.utils import int_from_bytes Sep 13 06:36:38.889014 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:36:38.889014 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: from cryptography.utils import int_from_bytes Sep 13 06:36:38.894329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:36:38.894329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: from cryptography.utils import int_from_bytes Sep 13 06:36:38.894785 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:36:38.894785 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: from cryptography.utils import int_from_bytes Sep 13 06:36:41.311972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 06:36:41.312511 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 06:36:41.312795 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 06:36:41.313042 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 06:36:41.313296 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 06:36:41.313684 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.314008 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.314330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.315536 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.315872 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.316182 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.316501 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.316825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.317158 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.317420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.317739 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.318207 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856385-1-iscsi {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.318541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.318846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.318959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 06:36:41.319319 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 06:36:41.319518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.319518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.319775 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 06:36:41.319879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.320072 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 06:36:41.320184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.320357 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 06:36:41.320481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.320724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.320909 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.321038 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.321373 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.321699 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.322160 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.322362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.322481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.322675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.322799 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.322999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.323224 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.323495 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.323715 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.323937 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.324156 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.324377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.324620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.324620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.325031 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856385-1-iscsi {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.325255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.325465 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.325682 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.325899 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.326116 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.326351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.326351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.326758 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856385-1-iscsi {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.327000 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.327208 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.327477 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.327690 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.327876 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.328082 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.328082 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.328418 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.328599 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.328782 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.328945 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.329090 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.329234 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.329421 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.329569 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.329772 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.329922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.330076 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.330227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.330546 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.330750 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.330915 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.331070 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.331221 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.331399 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.331562 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.331707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.331857 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.332002 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.332144 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856385-1-iscsi {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.332300 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.332446 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.332595 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.333445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.333620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.333774 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.333928 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.333928 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.334216 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.334389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.334903 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.335069 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.335223 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.335392 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.335545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.335688 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.335869 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.336110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.336272 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.336424 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.336572 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.336722 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.336876 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.337026 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.337171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.337315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.337464 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.337619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.337786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.337930 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.338129 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.338278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.338427 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.338578 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.338736 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.338888 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.339032 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.339182 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.339331 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.339546 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.339720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.339866 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.340010 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.340152 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.340296 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.340453 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.340605 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.340749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.340898 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.341053 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.341204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.341362 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.341523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.341669 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.341937 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.342101 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.342261 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.342419 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.342569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.342761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.343074 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.343519 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.343687 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.343840 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.344008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.344160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.344314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.344469 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.344648 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.344882 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.345135 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.345366 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.345516 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.345659 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.345812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.345957 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.346108 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.346264 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.346407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.346576 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.346729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.346879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.347022 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.347173 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.347316 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.347508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.347661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.347804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.347946 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.348113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.348303 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.348463 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.348607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.348750 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.348750 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.349018 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.349161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.349317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.349460 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.349610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.349760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.349910 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.350078 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.350223 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.350366 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.350517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.350659 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.350802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.351024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.351170 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.351320 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.351490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.351645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.351796 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.351985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.352157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.352311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.352463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.352607 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.352756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.352911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.353203 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.353655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.353821 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.353967 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.354110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.354788 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.354892 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.354979 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355071 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355300 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355399 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355493 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355641 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355712 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355783 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355854 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.355933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356164 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356308 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356469 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356542 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356613 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356692 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356765 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356845 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.356927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357000 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357000 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357137 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357453 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357543 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357702 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357774 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357851 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.357939 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358019 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358091 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358169 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358258 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358500 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358578 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358658 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358738 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.358919 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.359005 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.359089 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.359172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.359255 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.359340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.359526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.359642 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.359750 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.359857 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.359974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.360097 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.360218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.360329 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.360478 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.360607 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.360726 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.360851 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.360970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.361089 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.361207 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.361324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.361441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.362089 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.362213 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.362324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.362438 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.362547 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.362668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.362779 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.362895 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.363013 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.363131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.363241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.363384 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.363673 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.363828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.363972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.364135 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:36:41.364307 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.364464 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.364634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.364790 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.364935 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.366214 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.366374 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.366529 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.366674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.366830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.366985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.367136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.367299 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.367486 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.367645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.367796 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.367980 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.368136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.368285 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.368433 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.368593 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.368744 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.368885 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.369026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.369169 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.369329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.369479 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.369630 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.369779 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.369928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.370077 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.370234 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.370391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.370541 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.370683 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.370823 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.370971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.371128 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.371280 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.371633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.371791 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.371934 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.372082 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.372235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.372378 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.372378 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.372652 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.372793 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.372946 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.373087 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.373228 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.373420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.373566 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.373707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.373923 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.374073 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.374226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.374369 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.374509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.374649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.374798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.374949 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.375097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.375428 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.375588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.375740 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.375891 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.376040 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.376336 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.376495 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.376645 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.376801 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.376944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.377092 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.377299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.377949 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.378110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.378262 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.378404 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.378554 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.378702 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.378850 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.379000 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.379150 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.379300 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.379494 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.379646 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.379788 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.379788 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.380082 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.380232 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.380380 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.380522 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.380670 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.380824 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.380972 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.381114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.381254 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.381404 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.381553 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.381709 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.381850 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.382015 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.382157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.382297 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.382445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.382594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.382744 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.382895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.383043 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.383192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.383333 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.383509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.383659 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.383802 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.383960 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.384109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.384253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.384403 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.384556 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.384698 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.384847 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.384996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.385147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.385296 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.385590 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.385736 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.385889 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.386030 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.386180 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.386474 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.386633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.386784 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.386927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.391467 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.391668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.391827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.391988 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.392147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.392305 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.392472 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.392649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.392831 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.395052 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.395236 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.395412 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.395602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.395761 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.395916 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.396068 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.396269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.396440 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.396602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.396766 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.396920 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.397070 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.397221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.397364 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.397515 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.397664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.397808 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.397949 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.398095 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.398217 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.398345 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.398466 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.398577 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.398687 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.398797 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.398921 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.399032 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.399032 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.399243 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.399425 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.399544 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.400649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.400816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.400963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.401116 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.401266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.401408 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.401558 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.401710 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.401853 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402002 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402150 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402306 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.402448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.403604 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.403604 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.403604 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.403604 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.403604 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.403604 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.404416 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.404565 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.404715 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.404876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.405025 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.405166 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.405314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.405463 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.405611 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.405771 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.405771 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.406044 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.406185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.406326 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.406476 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.406618 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.406775 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.406921 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.407040 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.407150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.407268 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.407517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.407672 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.407822 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.407972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.408120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.408275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.408929 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.409098 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.411064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.411239 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.411431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.411594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.411739 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.412541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.412705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.412857 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.413009 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.413164 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.413320 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.413476 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.413629 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.413780 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.413930 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.414079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.414229 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.414640 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.414784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.414945 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.415070 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.415183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.415303 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.415850 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.416059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.416220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.416220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.416511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.416511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.416802 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.416994 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.417144 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.417293 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.417449 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.417607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.417607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.417906 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.418054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.418202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.418202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.418202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.418638 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.418786 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.418941 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.419091 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.419252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.419455 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.419613 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.419769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.419972 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.420150 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.420308 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.420458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.421328 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.421498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.421665 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.421822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.421981 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.422138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.422287 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.422434 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.422434 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.422727 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.422727 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.423030 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.423186 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.423333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.423531 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.423531 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.424739 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.424890 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.425033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.425182 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.425362 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.426311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.426494 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.426647 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.426798 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.426798 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.427076 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.427227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.427390 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.427550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.427701 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.427846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.427986 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.428140 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.428293 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.428434 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.428583 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.429270 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.429419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.429578 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.429733 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.429877 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.430019 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.430159 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.430309 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.430452 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.430607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.430719 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.430839 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.430946 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.431083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.431185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.431279 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.431411 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.431506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.431595 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.431692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.431778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.431875 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.431962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432401 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.432491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433007 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433105 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433188 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433262 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433341 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433437 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433437 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433615 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433774 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433867 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.433960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434046 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434270 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434363 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434437 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434437 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434585 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434585 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434731 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434821 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.434915 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.435002 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.435074 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.435157 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.435287 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.435719 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.435832 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.435928 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436272 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436409 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436596 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436786 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436786 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.436937 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437023 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437364 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437364 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437615 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437706 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437800 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437926 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.437926 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.438146 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.438286 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.438385 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.438516 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.438608 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.438693 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.438777 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.438860 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.438957 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.439044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.439137 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.439349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.439458 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.439556 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.439668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.439756 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.439847 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.439942 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440028 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440112 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440194 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440277 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440368 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440467 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440554 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440637 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440722 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.440985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.441115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.441207 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.441298 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.441383 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.441476 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.441568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.441653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.441772 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.441945 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.442248 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.442557 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.442861 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.443177 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.443515 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.443819 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.444124 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.444438 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.444747 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.445050 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.445369 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.445598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.445992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.446159 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.446313 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.446464 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.446600 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.446600 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.446893 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.447174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.447334 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.447528 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.447672 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.447916 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.448066 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.448187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.448187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.449210 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.449376 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.449376 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.449678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.449841 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.449841 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.450141 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.450290 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.450290 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.450593 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.450743 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.450743 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.451035 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.451183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.451183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.451561 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.451714 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.451714 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.451995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.452151 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.452316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.452761 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.453386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.453821 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.454039 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.454163 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.454489 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.454643 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.454810 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.455132 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.455231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.455509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.455845 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.456168 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.456481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.456789 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.457104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.457292 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.457472 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.457705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.457810 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.458044 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.458176 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.458468 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.458581 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.458851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.459020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.459147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.459241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.459352 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.459519 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.459706 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.459806 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.460023 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.460112 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.460333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.460519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.460673 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.460952 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.461132 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.461269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.461574 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.461731 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.461881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.462205 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.462324 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.462560 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.462691 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.462832 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.463020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.463148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.463351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.463498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.463695 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.463829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.464015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.464138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.464341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.464447 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.464666 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.464772 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.464983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.465076 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.465308 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.465412 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.465652 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.465740 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.465953 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.466159 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.466323 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.466467 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.466613 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.466754 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.466914 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.467059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.467229 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.467470 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.467654 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.467818 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.467989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.468147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.468304 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.468398 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.468502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.468575 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.468766 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.468946 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.469183 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.469352 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.469446 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.469540 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.469773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.470019 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.470120 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.470375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.470605 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.470706 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.471679 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.471796 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.471999 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.472314 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.472413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.472624 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.472939 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.473054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.473403 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.473501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.473575 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.473710 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.473876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.474040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.474189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.474367 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.474612 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.474714 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.474927 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.475021 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.475241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.475332 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.475599 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.475693 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.475908 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.476220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.476533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.476860 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.477168 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.477472 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.477778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.478105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.478412 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.478736 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.479160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.479499 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.479808 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.480230 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.480543 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.480856 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.481180 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.481505 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.481832 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.481998 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.482141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.482344 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.482458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.482681 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.482782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.483033 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.483145 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.483379 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.483487 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.483718 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.483813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.484039 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.484130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.484347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.484438 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.484676 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.484794 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.485003 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.485178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.485323 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.485582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.485683 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.485923 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.486060 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.486274 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.486536 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.487206 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.487302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.487580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.487681 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.487911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.488005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.488222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.488323 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.488532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.488637 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.488887 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.489000 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.489158 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.489262 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.489465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.489591 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.489791 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.489897 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.490100 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.490199 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.490412 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.490504 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.490724 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.490831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.491035 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.491134 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.491344 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.491471 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.491677 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.491784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.492004 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.492096 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.492311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.492402 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.492637 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.492742 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.492951 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.493041 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.493267 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.493357 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.493588 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.493687 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.493895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.493986 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.494212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.494301 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.494524 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.494616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.494827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.494929 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.495133 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.495239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.495461 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.495570 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.495790 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.495881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.496105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.496205 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.496421 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.496657 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.496753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.496838 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.497057 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.497154 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.497365 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.497463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.497675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.497767 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.497994 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.498089 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.498305 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.498397 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.498623 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.498757 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.498954 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.499057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.499256 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.499392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.499646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.499765 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.499936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.500039 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.500247 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.500341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.500552 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.500655 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.500857 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.500952 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.501161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.501265 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.501468 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.501575 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.501770 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.501864 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.502072 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.502256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.502400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.502576 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.502753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.502920 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.503072 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.503211 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.503408 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.503557 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.503705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.503844 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.504000 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.504149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.504314 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.504466 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.505218 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.505374 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.505523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.505694 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.505844 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.505992 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.506140 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.506295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.506454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.506742 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.506904 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.507061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.507210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.507416 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.507849 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.508210 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.508523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.508700 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.508846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.508846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.509029 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.509148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.509245 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.509340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.509426 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.509517 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.509609 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.509704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.509970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510152 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510320 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510320 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510488 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510575 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510667 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510760 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.510930 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.511028 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.511114 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.511198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.511463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.511572 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.511777 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.511879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.512110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.512210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.512439 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.512536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.512752 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.512855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.513066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.513171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.513396 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.513491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.513720 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.513811 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.514053 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.514154 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.514393 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.514494 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.514712 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.514807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.515028 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.515121 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.515348 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.515513 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.515687 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.515792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.516001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.516105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.516315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.516430 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.516647 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.516928 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.517046 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.517246 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.517360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.517562 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.517673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.517874 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.517978 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.518185 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.518299 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.518495 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.518597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.518809 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.518929 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.519120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.519221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.519453 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.519548 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.519767 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.519870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.520117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.520234 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.520388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.520483 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.520708 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.520800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.521038 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.521140 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.521356 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.521448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.521665 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.521759 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.521977 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.522070 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.522286 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.522377 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.522635 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.522805 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.522946 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.523121 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.523271 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.523481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.523634 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.523813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.523971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.524137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.524293 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.524459 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.524631 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.524776 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.524961 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.525104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.525285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.525409 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.525602 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.525704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.525923 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.526017 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.526250 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.526344 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.526560 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.526662 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.526869 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.526992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.527183 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.527293 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.527520 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.527685 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.527989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.528127 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.528271 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.528420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.528571 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.528722 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.528871 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.529052 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.529228 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.529325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.529467 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.529607 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.529700 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.529913 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.530057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.530236 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.530339 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.530548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.530649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.530855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.530946 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.531166 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.531266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.531495 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.531591 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.531813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.531917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.532126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.532220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.532430 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.532523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.532737 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.532837 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.533048 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.533148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.533359 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.533993 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.534192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.534305 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.534489 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.534596 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.534791 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.534892 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.535106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.535211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.535457 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.535680 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.535773 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.535997 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.536097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.536303 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.536405 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.536615 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.536707 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.536938 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.537152 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.537253 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.537520 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.537657 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.537823 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.537918 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.538134 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.538237 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.538438 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.538539 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.538768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.538865 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.539087 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.539179 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.539682 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.539778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.540002 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.540107 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.540317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.540446 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.540632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.540727 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.540948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.541043 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.541251 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.541343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.541555 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.541655 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.541875 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.541977 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.542188 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.542282 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.542512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.542611 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.542826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.542928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.543138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.543239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.543481 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.543587 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.543818 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.543920 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.544156 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.544359 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.544459 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.544696 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.544798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.545019 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.545120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.545352 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.545446 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.545675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.545779 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.545983 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.546074 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.546291 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.546382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.546596 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.546702 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.546907 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.546999 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.547219 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.547329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.547557 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.547655 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.547868 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.547971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.548178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.548272 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.548490 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.548583 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.548799 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.548900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.549721 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.549835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.549976 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.550070 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.550286 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.550422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.550595 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.550844 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.550947 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.551165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.551265 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.551521 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.551616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.551834 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.551936 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.552149 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.552241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.552476 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.552566 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.552797 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.552889 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.553115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.553206 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.553423 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.553520 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.553732 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.553825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.554047 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.554136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.554356 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.554464 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.554663 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.554761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.554969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.555058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.555284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.555483 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.555614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.555706 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.555936 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.556038 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.556240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.556341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.556663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.556781 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.556975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.557142 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.557321 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.557465 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.557609 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.557789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.557918 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.558123 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.558224 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.558448 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.558542 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.558765 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.558863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.559098 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.559202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.559436 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.559545 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.559826 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.559954 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.560075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.560177 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.560392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.560527 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.560701 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.560800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.561011 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.561105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.561321 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.561428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.561627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.561726 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.561936 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.562109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.562251 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.562345 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.562558 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.562648 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.562858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.562949 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.563159 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.563252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.563503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.563596 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.563820 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.563921 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.564135 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.564227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.564435 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.564536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.564760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.564855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.565067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.565167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.565368 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.565470 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.565670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.565763 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.565970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.566070 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.566271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.566447 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.566571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.566667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.566871 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.566964 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.567180 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.567316 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.567510 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.567664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.567810 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.567973 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.568109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.568302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.568397 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.568610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.568710 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.568918 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.569019 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.569239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.569332 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.569556 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.569664 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.569889 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.570017 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.570205 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.570319 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.570532 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.570627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.570843 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.570960 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.571165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.571273 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.571508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.571735 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.571847 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.572076 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.572192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.572402 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.572505 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.572731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.572846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.573036 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.573139 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.573345 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.573462 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.573655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.573767 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.573959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.574051 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.574263 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.574354 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.574589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.574682 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.574905 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.574998 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.575209 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.575300 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.575547 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.575650 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.575860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.575953 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.576173 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.576274 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.576485 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.576585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.576796 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.576897 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.577109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.577210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.577418 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.577509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.578208 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.578331 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.578429 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.578527 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.578622 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.578717 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.578812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.578900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.578994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.579101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.579220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.579439 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.579601 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.579761 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.579931 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.580189 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.580381 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.580533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.580705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.580998 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.581165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.581324 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.581473 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.581629 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.581786 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.581936 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.582093 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.582272 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.582272 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.582715 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.582872 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.583031 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.583189 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.583347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.583606 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.583761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.583761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.584054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.584204 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.584366 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.584527 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.584676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.584824 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 06:36:41.584986 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.584986 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.584986 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.585768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.585768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.585953 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.586133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.586466 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.586807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.587139 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.587494 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.587807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.588112 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.588419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.588730 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.589054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.589369 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.589678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.590285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.590285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.590584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.590889 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.591177 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.591505 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.591821 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.592126 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.594660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.594660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.594660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.594660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.594660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.594660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.594660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.594660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.595413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.595413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.595413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.595738 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.596600 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.596923 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.597252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.597571 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.597902 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.598213 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.598540 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.598866 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.599187 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.599525 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.599863 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.600177 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.600490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.600805 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.601119 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.601428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.601739 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.602069 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.602398 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.602707 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.603040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.603376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.603724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.604044 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.604358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.604691 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.605003 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.605316 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.605628 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.605942 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.606256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.606574 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.606885 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.607196 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.607539 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.607859 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.608190 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.608560 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.608830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.609158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.609487 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.609838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.610154 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.610502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.610832 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.611204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.611492 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.612340 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:36:41.612586 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 06:36:41.647507 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO dbcounter [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Registered counter for database nova_api Sep 13 06:36:41.668263 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_db.sqlalchemy.engines [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:36:41.675252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO dbcounter [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Registered counter for database nova_api Sep 13 06:36:41.675734 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writer thread running {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:36:41.695409 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_db.sqlalchemy.engines [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:36:41.701822 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writer thread running {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:36:41.732433 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.context [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5983513-f545-4028-b6c7-d14599d1f916(cell1) {{(pid=132399) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 06:36:41.736548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:36:41.737621 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:36:41.739184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:36:41.739993 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:36:41.740452 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:36:41.742455 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:36:41.744491 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO dbcounter [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Registered counter for database nova_cell0 Sep 13 06:36:41.748622 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO dbcounter [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Registered counter for database nova_cell1 Sep 13 06:36:41.756274 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_db.sqlalchemy.engines [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:36:41.757580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_db.sqlalchemy.engines [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:36:41.758579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.context [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5983513-f545-4028-b6c7-d14599d1f916(cell1) {{(pid=132398) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 06:36:41.762651 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:36:41.763128 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:36:41.764336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writer thread running {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:36:41.764728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:36:41.765485 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:36:41.765649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writer thread running {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:36:41.765939 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:36:41.768008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:36:41.770008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO dbcounter [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Registered counter for database nova_cell0 Sep 13 06:36:41.774061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO dbcounter [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Registered counter for database nova_cell1 Sep 13 06:36:41.781175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_db.sqlalchemy.engines [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:36:41.783346 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_db.sqlalchemy.engines [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:36:41.789586 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writer thread running {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:36:41.914180 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO dbcounter [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Registered counter for database nova_cell0 Sep 13 06:36:41.921194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_db.sqlalchemy.engines [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:36:41.925549 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writer thread running {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:36:41.933145 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writer thread running {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:36:41.942942 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO dbcounter [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Registered counter for database nova_cell0 Sep 13 06:36:41.951271 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_db.sqlalchemy.engines [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:36:41.956183 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writer thread running {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:36:42.244711 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: WARNING keystonemiddleware.auth_token [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:36:42.251968 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: WARNING keystonemiddleware.auth_token [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:36:42.275107 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: WARNING keystonemiddleware.auth_token [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:36:42.282419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: WARNING keystonemiddleware.auth_token [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:36:42.606559 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: WARNING keystonemiddleware.auth_token [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:36:42.613706 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: WARNING keystonemiddleware.auth_token [None req-a55bb01e-b240-4acf-9d33-3f4418948b6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:36:42.619081 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5641cce0f9c0 pid: 132399 (default app) Sep 13 06:36:42.644475 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: WARNING keystonemiddleware.auth_token [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 06:36:42.650448 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: WARNING keystonemiddleware.auth_token [None req-97d4615a-1af6-422f-ae8d-c78880734caf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 06:36:42.655758 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5641cce0f9c0 pid: 132398 (default app) Sep 13 06:37:18.574697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=3 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:18.575992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=3 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:18.578384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=3 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:18.580420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=3 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:18.784590 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:18.786400 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:18.787930 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:18.788952 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:19.795924 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5da8a2b2-ea91-4903-b2d1-81413cf7088b tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Action: 'create', calling method: .version_select at 0x7fdc0e51f430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1388301890"}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:19.854233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-deb4e560-ee05-4ac8-874b-93233a98eab5 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Action: 'create', calling method: .version_select at 0x7fdc0e51d430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-623254002", "metadata": {"Type": "work"}}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-deb4e560-ee05-4ac8-874b-93233a98eab5 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Request method failure captured: Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 121 Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUeIPF0-t06TZNHOX1xMdJfxs65VsaksbmDJUFXXKxdvga2IoTSCDd2II02BCwSKqNc_awb5OriBE8cmXt9xA5hzWweRQah7Xea6Zc_UzTulT8yo1YzcedwNXNbxWRzcKSnD-d6HP2gAkkLAJ9D4VwxbW22Qa3IZL6TFDcQyGVvQ2s Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:37:19.875410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76be398ab12345b3a096922e01be425e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76be398ab12345b3a096922e01be425e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 5ab14b836bac4b178d928e0064e44b7b Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-623254002", "metadata": {"Type": "work"}}} Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: Sep 13 06:37:19.877083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-623254002', 'metadata': {'Type': 'work'}}}} Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise error Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:37:19.878058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 06:37:19.879698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 06:37:19.880995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 06:37:19.880995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.880995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-deb4e560-ee05-4ac8-874b-93233a98eab5 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:37:19.880995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-deb4e560-ee05-4ac8-874b-93233a98eab5 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.098033 Sep 13 06:37:19.883069 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Sep 13 06:37:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 06:37:19.902277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-aab1526a-80f5-4de2-9759-6ac4d7f92948 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Action: 'create', calling method: .version_select at 0x7fdc0e51dd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-326378811", "metadata": {"Type": "work"}}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-aab1526a-80f5-4de2-9759-6ac4d7f92948 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Request method failure captured: Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 119 Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUeIPF0-t06TZNHOX1xMdJfxs65VsaksbmDJUFXXKxdvga2IoTSCDd2II02BCwSKqNc_awb5OriBE8cmXt9xA5hzWweRQah7Xea6Zc_UzTulT8yo1YzcedwNXNbxWRzcKSnD-d6HP2gAkkLAJ9D4VwxbW22Qa3IZL6TFDcQyGVvQ2s Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:37:19.926515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76be398ab12345b3a096922e01be425e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76be398ab12345b3a096922e01be425e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 5ab14b836bac4b178d928e0064e44b7b Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-326378811", "metadata": {"Type": "work"}}} Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: Sep 13 06:37:19.928171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-326378811', 'metadata': {'Type': 'work'}}}} Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise error Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi '0' Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:37:19.929259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 06:37:19.930882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 06:37:19.932304 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 06:37:19.932304 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.932304 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-aab1526a-80f5-4de2-9759-6ac4d7f92948 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:37:19.932304 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-aab1526a-80f5-4de2-9759-6ac4d7f92948 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.040606 Sep 13 06:37:19.932304 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 2/2] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Sep 13 06:37:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 06:37:19.953665 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-471053b7-79b6-4852-b0eb-b3cae09bf423 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Action: 'create', calling method: .version_select at 0x7fdc0e3db160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1001882469", "metadata": {"Type": "work"}}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-471053b7-79b6-4852-b0eb-b3cae09bf423 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Request method failure captured: Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 119 Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUeIPF0-t06TZNHOX1xMdJfxs65VsaksbmDJUFXXKxdvga2IoTSCDd2II02BCwSKqNc_awb5OriBE8cmXt9xA5hzWweRQah7Xea6Zc_UzTulT8yo1YzcedwNXNbxWRzcKSnD-d6HP2gAkkLAJ9D4VwxbW22Qa3IZL6TFDcQyGVvQ2s Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:37:19.961285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76be398ab12345b3a096922e01be425e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76be398ab12345b3a096922e01be425e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 5ab14b836bac4b178d928e0064e44b7b Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1001882469", "metadata": {"Type": "work"}}} Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: Sep 13 06:37:19.963579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1001882469', 'metadata': {'Type': 'work'}}}} Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise error Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi '' Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:37:19.964661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 06:37:19.966232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 06:37:19.967502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 06:37:19.967502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:19.967502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-471053b7-79b6-4852-b0eb-b3cae09bf423 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:37:19.967502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-471053b7-79b6-4852-b0eb-b3cae09bf423 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027688 Sep 13 06:37:19.968061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 3/3] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Sep 13 06:37:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 06:37:19.988959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d2633778-ea25-4230-ae75-6e9dcbbd2149 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Calling method '.version_select at 0x7fdc0e3dbc10>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:20.544912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-d2633778-ea25-4230-ae75-6e9dcbbd2149 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] HTTP exception thrown: Volume tempest-invalid-617323480 could not be found. Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d2633778-ea25-4230-ae75-6e9dcbbd2149 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Request method failure captured: Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-617323480 HTTP/1.1 Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUeIPF0-t06TZNHOX1xMdJfxs65VsaksbmDJUFXXKxdvga2IoTSCDd2II02BCwSKqNc_awb5OriBE8cmXt9xA5hzWweRQah7Xea6Zc_UzTulT8yo1YzcedwNXNbxWRzcKSnD-d6HP2gAkkLAJ9D4VwxbW22Qa3IZL6TFDcQyGVvQ2s Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:37:20.549696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76be398ab12345b3a096922e01be425e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76be398ab12345b3a096922e01be425e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 5ab14b836bac4b178d928e0064e44b7b Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Volume tempest-invalid-617323480 could not be found. Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'tempest-invalid-617323480'} Sep 13 06:37:20.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-617323480 could not be found. (HTTP 404) (Request-ID: req-9cb36135-cde0-4a3f-99e1-442c52e00596) Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:20.552445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 06:37:20.554131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-617323480 could not be found. Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:37:20.556377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-617323480 could not be found. Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-617323480 could not be found. Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d2633778-ea25-4230-ae75-6e9dcbbd2149 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Returning 404 to user: Volume tempest-invalid-617323480 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:37:20.559277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d2633778-ea25-4230-ae75-6e9dcbbd2149 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-617323480" status: 404 len: 98 microversion: 2.1 time: 0.582478 Sep 13 06:37:20.561967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 4/4] 10.222.0.17 () {58 vars in 1215 bytes} [Tue Sep 13 06:37:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-617323480 => generated 98 bytes in 586 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 06:37:20.591006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ce0d68f7-c0ce-4e03-a8a0-072d134b496f tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.023036 Sep 13 06:37:20.592157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 5/5] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Sep 13 06:37:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 06:37:20.616547 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-92dd8a15-6de1-4fae-9d36-7f8375ee0214 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014441 Sep 13 06:37:20.619948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 6/6] 10.222.0.17 () {58 vars in 1137 bytes} [Tue Sep 13 06:37:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 06:37:20.636168 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2d9c6d84-ec3b-47a6-9f8d-fc2503aa7849 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Calling method '.version_select at 0x7fdc0e30f3a0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:21.017162 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-2d9c6d84-ec3b-47a6-9f8d-fc2503aa7849 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] HTTP exception thrown: Volume 068c7b41-294b-4569-8e38-3959631ce55c could not be found. Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2d9c6d84-ec3b-47a6-9f8d-fc2503aa7849 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Request method failure captured: Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: DELETE /compute/v2.1/os-volumes/068c7b41-294b-4569-8e38-3959631ce55c HTTP/1.1 Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUeIPF0-t06TZNHOX1xMdJfxs65VsaksbmDJUFXXKxdvga2IoTSCDd2II02BCwSKqNc_awb5OriBE8cmXt9xA5hzWweRQah7Xea6Zc_UzTulT8yo1YzcedwNXNbxWRzcKSnD-d6HP2gAkkLAJ9D4VwxbW22Qa3IZL6TFDcQyGVvQ2s Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:37:21.019658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76be398ab12345b3a096922e01be425e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76be398ab12345b3a096922e01be425e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 5ab14b836bac4b178d928e0064e44b7b Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Volume 068c7b41-294b-4569-8e38-3959631ce55c could not be found. Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '068c7b41-294b-4569-8e38-3959631ce55c'} Sep 13 06:37:21.021209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 068c7b41-294b-4569-8e38-3959631ce55c could not be found. (HTTP 404) (Request-ID: req-d8abc8a0-6732-4a6c-ae4e-a0bf4f0c99a3) Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:21.021971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 06:37:21.023058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 068c7b41-294b-4569-8e38-3959631ce55c could not be found. Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 06:37:21.026233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 068c7b41-294b-4569-8e38-3959631ce55c could not be found. Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 068c7b41-294b-4569-8e38-3959631ce55c could not be found. Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2d9c6d84-ec3b-47a6-9f8d-fc2503aa7849 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Returning 404 to user: Volume 068c7b41-294b-4569-8e38-3959631ce55c could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2d9c6d84-ec3b-47a6-9f8d-fc2503aa7849 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/068c7b41-294b-4569-8e38-3959631ce55c" status: 404 len: 109 microversion: 2.1 time: 0.396155 Sep 13 06:37:21.027318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 7/7] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Sep 13 06:37:20 2022] DELETE /compute/v2.1/os-volumes/068c7b41-294b-4569-8e38-3959631ce55c => generated 109 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:37:21.035978 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-852dd293-f461-4f8f-95d2-b35fc8f95ab5 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Calling method '.version_select at 0x7fdc0e30f280>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:21.134848 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5da8a2b2-ea91-4903-b2d1-81413cf7088b tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.588053 Sep 13 06:37:21.145249 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 1/8] 10.222.0.17 () {60 vars in 1155 bytes} [Tue Sep 13 06:37:18 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2591 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 06:37:21.151668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f5790ca7-a9fe-41b8-ac13-58c95a2a4ea7 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3f1310>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:21.215593 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-852dd293-f461-4f8f-95d2-b35fc8f95ab5 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] HTTP exception thrown: Volume 0157ebf5-a702-4f3e-ad2e-d2879382bc41 could not be found. Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-852dd293-f461-4f8f-95d2-b35fc8f95ab5 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Request method failure captured: Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/os-volumes/0157ebf5-a702-4f3e-ad2e-d2879382bc41 HTTP/1.1 Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUeIPF0-t06TZNHOX1xMdJfxs65VsaksbmDJUFXXKxdvga2IoTSCDd2II02BCwSKqNc_awb5OriBE8cmXt9xA5hzWweRQah7Xea6Zc_UzTulT8yo1YzcedwNXNbxWRzcKSnD-d6HP2gAkkLAJ9D4VwxbW22Qa3IZL6TFDcQyGVvQ2s Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:37:21.218149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76be398ab12345b3a096922e01be425e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76be398ab12345b3a096922e01be425e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76be398ab12345b3a096922e01be425e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 76be398ab12345b3a096922e01be425e Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesNegativeTest-454910325 Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 5ab14b836bac4b178d928e0064e44b7b Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesNegativeTest-454910325-project Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Volume 0157ebf5-a702-4f3e-ad2e-d2879382bc41 could not be found. Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '0157ebf5-a702-4f3e-ad2e-d2879382bc41'} Sep 13 06:37:21.219445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0157ebf5-a702-4f3e-ad2e-d2879382bc41 could not be found. (HTTP 404) (Request-ID: req-031b5cba-f122-4c19-842d-9e073d5b5b99) Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:21.220284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 06:37:21.221414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0157ebf5-a702-4f3e-ad2e-d2879382bc41 could not be found. Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 06:37:21.222526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0157ebf5-a702-4f3e-ad2e-d2879382bc41 could not be found. Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0157ebf5-a702-4f3e-ad2e-d2879382bc41 could not be found. Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-852dd293-f461-4f8f-95d2-b35fc8f95ab5 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] Returning 404 to user: Volume 0157ebf5-a702-4f3e-ad2e-d2879382bc41 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-852dd293-f461-4f8f-95d2-b35fc8f95ab5 tempest-VolumesNegativeTest-454910325 tempest-VolumesNegativeTest-454910325-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/0157ebf5-a702-4f3e-ad2e-d2879382bc41" status: 404 len: 109 microversion: 2.1 time: 0.190554 Sep 13 06:37:21.223649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 8/9] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:37:21 2022] GET /compute/v2.1/os-volumes/0157ebf5-a702-4f3e-ad2e-d2879382bc41 => generated 109 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 06:37:21.329131 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f5790ca7-a9fe-41b8-ac13-58c95a2a4ea7 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba" status: 200 len: 345 microversion: 2.1 time: 0.181333 Sep 13 06:37:21.330496 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 2/10] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:37:21 2022] GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba => generated 345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:37:22.349335 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3b437a9b-8f4d-44e0-967a-ad700397a55e tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3dbe50>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:22.412031 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3b437a9b-8f4d-44e0-967a-ad700397a55e tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba" status: 200 len: 345 microversion: 2.1 time: 0.070858 Sep 13 06:37:22.414752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 9/11] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:37:22 2022] GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:23.428746 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fc0a3929-192b-4c60-b5b1-7d2eb50b768c tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3f19d0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:23.646246 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fc0a3929-192b-4c60-b5b1-7d2eb50b768c tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba" status: 200 len: 346 microversion: 2.1 time: 0.221342 Sep 13 06:37:23.646846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 3/12] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:37:23 2022] GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba => generated 346 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:23.662148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-01156ff7-0cb5-4358-a20e-463db78e7dea tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Action: 'create', calling method: .version_select at 0x7fdc0e30f9d0>, body: {"snapshot": {"volume_id": "e52d40e5-efa1-4fc7-96ca-d6ff09c183ba", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1382848790"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:24.080861 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-01156ff7-0cb5-4358-a20e-463db78e7dea tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.424346 Sep 13 06:37:24.082120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 10/13] 10.222.0.17 () {60 vars in 1162 bytes} [Tue Sep 13 06:37:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:24.094185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-032ecca7-7082-4f9b-b54b-ffd232389990 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3880d0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:24.222983 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-032ecca7-7082-4f9b-b54b-ffd232389990 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.133298 Sep 13 06:37:24.234506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a932c019-298d-4285-9d68-b3cd41dae5d4 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3b9160>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:24.235035 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 4/14] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:24 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:24.357531 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a932c019-298d-4285-9d68-b3cd41dae5d4 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.126693 Sep 13 06:37:24.369719 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 11/15] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Sep 13 06:37:24 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:24.371084 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2b90f553-b02f-474f-9413-982f0dce90b9 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3f1ca0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:24.446816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2b90f553-b02f-474f-9413-982f0dce90b9 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.080977 Sep 13 06:37:24.447393 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 5/16] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:24 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:25.460438 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-db521932-f35b-4eac-b358-a8a22ef384a7 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3b99d0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:25.511738 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-db521932-f35b-4eac-b358-a8a22ef384a7 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.056135 Sep 13 06:37:25.520559 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 12/17] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:25 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:26.526217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-83422bdb-8243-4701-a72a-4b2dbe137ab3 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3f15e0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:26.610161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-83422bdb-8243-4701-a72a-4b2dbe137ab3 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.089042 Sep 13 06:37:26.611299 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 6/18] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:26 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:27.623309 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-86e1409f-b0dc-4683-9e3d-6acf6ee5593b tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3b90d0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:27.707964 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-86e1409f-b0dc-4683-9e3d-6acf6ee5593b tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.081396 Sep 13 06:37:27.707964 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 13/19] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:27 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:28.729194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bdb8269c-43ba-4173-ae50-ae3ab6eef393 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3881f0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:28.807131 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-bdb8269c-43ba-4173-ae50-ae3ab6eef393 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.088828 Sep 13 06:37:28.808677 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 7/20] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:28 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:29.820886 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-87d091ec-85e2-409a-a6ee-769a35ea5699 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e30fca0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:29.887996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-87d091ec-85e2-409a-a6ee-769a35ea5699 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.071912 Sep 13 06:37:29.890695 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 14/21] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:29 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:30.827175 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-67152fa2-3f50-41b8-b17a-ca3440c51026 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'create', calling method: .version_select at 0x7fdc0e3f1550>, body: {"keypair": {"name": "tempest-keypair-737027912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLf0BhD57KbQHMHDJ8NEGOdKV/Sn6GmeDsctmUO4b/TSMoj6nqn2JdSjzmNVlWO0fb+WcklZ/l85Qtj3wREaTEDQbn2nCWMk5ZwJCpgPePXH57kWBEXuf/HSlev27jA2JQ=="}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:30.903456 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-59ff858a-3eca-4ad6-9221-7dfddaf2d92e tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3b9310>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:30.975786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-59ff858a-3eca-4ad6-9221-7dfddaf2d92e tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 288 microversion: 2.1 time: 0.077448 Sep 13 06:37:30.976443 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 15/22] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:30 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 288 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:37:30.987977 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-996a5c53-b90d-4480-893d-e50a8cc13947 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e3b9d30>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:31.010498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-67152fa2-3f50-41b8-b17a-ca3440c51026 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Getting quotas for project 2645e663e8564c0bb7e0da327a6019bf. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:37:31.031022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-67152fa2-3f50-41b8-b17a-ca3440c51026 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Getting quotas for user a8b45d538d6e4749b3997d5e6845dfe5 and project 2645e663e8564c0bb7e0da327a6019bf. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:37:31.137574 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-996a5c53-b90d-4480-893d-e50a8cc13947 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 202 len: 0 microversion: 2.1 time: 0.153335 Sep 13 06:37:31.138688 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 16/23] 10.222.0.17 () {58 vars in 1254 bytes} [Tue Sep 13 06:37:30 2022] DELETE /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:37:31.153442 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-60dacd52-bc2a-4411-b0d8-5f82c598c2d9 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e30f430>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:31.181359 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-67152fa2-3f50-41b8-b17a-ca3440c51026 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.616851 Sep 13 06:37:31.184820 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 8/24] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Sep 13 06:37:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:31.217256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-60dacd52-bc2a-4411-b0d8-5f82c598c2d9 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.074455 Sep 13 06:37:31.228169 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 17/25] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:31 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:32.232947 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-382f604a-1ffa-4d6c-be3e-493d67fb6622 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e36e1f0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:32.305106 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-382f604a-1ffa-4d6c-be3e-493d67fb6622 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.078709 Sep 13 06:37:32.305908 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 9/26] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:32 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:33.318711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3e035e2c-3115-4e0d-86e6-3ebec6fa95af tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e30f700>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:33.378575 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3e035e2c-3115-4e0d-86e6-3ebec6fa95af tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.063660 Sep 13 06:37:33.379142 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 18/27] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:33 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:33.903918 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1699936742", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "networks": [{"uuid": "1f04137e-cffb-4a97-9d07-eb7923e17ae2"}]}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:34.106544 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.network.neutron [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] validate_networks() for [('1f04137e-cffb-4a97-9d07-eb7923e17ae2', None, None, None, None, None)] {{(pid=132399) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:37:34.390769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ad67258b-6cf5-4642-a80c-5b58ba6d168e tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e30fe50>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:34.449497 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ad67258b-6cf5-4642-a80c-5b58ba6d168e tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.062629 Sep 13 06:37:34.450130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 19/28] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:34 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:37:35.464122 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-41dc8a99-a306-4268-87bd-095b17e3c69c tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e30f550>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:35.510735 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-41dc8a99-a306-4268-87bd-095b17e3c69c tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 200 len: 287 microversion: 2.1 time: 0.052365 Sep 13 06:37:35.511713 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 20/29] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:35 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:35.575749 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-958688699", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "499735c8-cc2d-4c3c-abac-f686f30e040d"}], "security_groups": [{"name": "tempest-securitygroup--1186818177"}], "key_name": "tempest-keypair-737027912", "user_data": "}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:35.931809 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] validate_networks() for [('499735c8-cc2d-4c3c-abac-f686f30e040d', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:37:37.360067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Flavor limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:37:37.360652 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Image limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:37:37.361131 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Flavor pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:37:37.361655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Image pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:37:37.362065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:37:37.409701 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:37.410788 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:37.411465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:37.418251 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:37.419769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:37.421191 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:37.505720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:37:37.506266 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:37:37.506852 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:37:37.507382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:37:37.508147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:37:37.509653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Getting quotas for project efe32000613545748673eaa2633ff1ea. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:37:37.515792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Getting quotas for user 5c95396abaf14d5c8b217772fc52f28b and project efe32000613545748673eaa2633ff1ea. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:37:37.542296 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:37.542296 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:37.543013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:37.545374 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:37.545696 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Going to run 1 instances... {{(pid=132399) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:37:37.547500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:37.548042 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:37.549206 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:37:37.662913 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Getting quotas for project 2645e663e8564c0bb7e0da327a6019bf. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:37:37.694114 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Getting quotas for user a8b45d538d6e4749b3997d5e6845dfe5 and project 2645e663e8564c0bb7e0da327a6019bf. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:37:37.721394 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:37:37.750177 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:37:37.751838 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b00e44c9-f2f6-428c-8b6e-59144e34a60a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.346702 Sep 13 06:37:37.755040 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 10/30] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:37:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:37:37.773185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0af5c1a1-9947-4886-8c22-aeb518146c33 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0e2bb5e0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:37.839752 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-0af5c1a1-9947-4886-8c22-aeb518146c33 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] HTTP exception thrown: Snapshot 7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c could not be found. Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0af5c1a1-9947-4886-8c22-aeb518146c33 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Request method failure captured: Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c HTTP/1.1 Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUeWNHA-PrsaTMX0XSg0eNGkIKGCKsnnm3FEZ-DIQnp7RaWnF1X_BrnKiYpQz_I1LLRb2fWAtO9WZo24cU-F1Ez7hWT9vvrm1mXYu9_xjVveaUtj76hQAt-4t1dAzW6GsPellOryWYgJ4XYT-4le_BN8Gmek-oqFQOmNYzQURv_EBY Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: cb28003c92114e8cb12c1f9525cefc6f Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:37:37.844216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: cb28003c92114e8cb12c1f9525cefc6f Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-VolumesSnapshotsTestJSON-365706033-project Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 18ab3f0478b04bfba7a54ed638b047a6 Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-VolumesSnapshotsTestJSON-365706033-project Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Snapshot 7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c could not be found. Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c'} Sep 13 06:37:37.845384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c could not be found. (HTTP 404) (Request-ID: req-24bc2d7d-2eaf-4b82-84f7-a6b42365f934) Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:37:37.846148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 06:37:37.847044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c could not be found. Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 06:37:37.848024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c could not be found. Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c could not be found. Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0af5c1a1-9947-4886-8c22-aeb518146c33 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Returning 404 to user: Snapshot 7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:37:37.849308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0af5c1a1-9947-4886-8c22-aeb518146c33 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c" status: 404 len: 111 microversion: 2.1 time: 0.089701 Sep 13 06:37:37.852463 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 11/31] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Sep 13 06:37:37 2022] GET /compute/v2.1/os-snapshots/7bfde4d7-e2ce-4f76-86df-4a60b40cdf1c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:37:37.987084 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-87fddd29-2c57-494f-b2ec-84030bb4db11 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.416049 Sep 13 06:37:37.992258 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 21/32] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:37:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:37:38.007025 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0557a260-7e65-453b-9946-84037fb106df tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:38.008641 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0557a260-7e65-453b-9946-84037fb106df tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:38.204932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0557a260-7e65-453b-9946-84037fb106df tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:38.233683 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0557a260-7e65-453b-9946-84037fb106df tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1215 microversion: 2.1 time: 0.238972 Sep 13 06:37:38.236394 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 22/33] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:37 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1215 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:38.249753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9958d873-3fe1-4b2d-ae1b-5446e400e780 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0da2c310>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:38.264520 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2086385939", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:38.357236 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.network.neutron [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] validate_networks() for [('8ea4fb14-b1a8-4860-a583-c1a571d4625e', None, None, None, None, None)] {{(pid=132399) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:37:38.480702 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9958d873-3fe1-4b2d-ae1b-5446e400e780 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba" status: 202 len: 0 microversion: 2.1 time: 0.242658 Sep 13 06:37:38.481639 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 23/34] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Sep 13 06:37:38 2022] DELETE /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:37:38.489721 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a331e958-02e8-4416-91a3-d0649adc1ddc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:38.490862 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a331e958-02e8-4416-91a3-d0649adc1ddc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:38.610278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a331e958-02e8-4416-91a3-d0649adc1ddc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:38.618964 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a331e958-02e8-4416-91a3-d0649adc1ddc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1236 microversion: 2.1 time: 0.136132 Sep 13 06:37:38.619582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 24/35] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:38 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1236 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:38.639946 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-973cb5b2-8069-4abb-b299-a2c4b12efc90 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0d9d5e50>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:38.756136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-973cb5b2-8069-4abb-b299-a2c4b12efc90 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba" status: 200 len: 345 microversion: 2.1 time: 0.114992 Sep 13 06:37:38.756941 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 25/36] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:37:38 2022] GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:39.386878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Flavor limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:37:39.386878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Image limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:37:39.386878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Flavor pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:37:39.386878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Image pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:37:39.386878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:37:39.402265 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:39.402752 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:39.404278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:39.407545 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:39.408182 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:39.410479 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:39.453339 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Getting quotas for project 2a2a801692c84c34b713aca165f69761. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:37:39.464508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Getting quotas for user 3a0a80a54cdc4107a508ca480b992319 and project 2a2a801692c84c34b713aca165f69761. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:37:39.494022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Going to run 1 instances... {{(pid=132399) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:37:39.496414 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:37:39.652268 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ae24d408-58af-4f27-86e3-20bee25cc2f5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.796337 Sep 13 06:37:39.664496 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 12/37] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:37:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:37:39.690416 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-44d689ed-e5ef-4126-aef6-c48d1ca7eaaa tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:39.691310 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-44d689ed-e5ef-4126-aef6-c48d1ca7eaaa tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:39.697231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3cabfc71-9a2c-4799-bdcf-74511489694d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: .version_select at 0x7fdc0d9dd5e0>, body: {"keypair": {"name": "tempest-keypair-1883974686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtKsnhkZW+XfV4sIAVTf6l2gjw6HRCpQ2Fsmfms9Kyo50MH3oXSiQHJqjPq+L1eFlkQ1MgFHSOeuyXJQFnFVUbIZFBRHsdWjPGlLPf2MiyfmutERgpJmm2WbN5jndwXvg=="}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:39.749339 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-3cabfc71-9a2c-4799-bdcf-74511489694d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'key_pairs'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:37:39.758465 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-3cabfc71-9a2c-4799-bdcf-74511489694d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for user cac2d22d853a4984b229911bde3a450b and project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'key_pairs'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:37:39.874648 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3cabfc71-9a2c-4799-bdcf-74511489694d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.688186 Sep 13 06:37:39.883513 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 26/38] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Sep 13 06:37:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:37:39.897391 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c5326e04-3fe1-4366-8c8a-43f98453c0bc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:39.898327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c5326e04-3fe1-4366-8c8a-43f98453c0bc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:40.051272 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-44d689ed-e5ef-4126-aef6-c48d1ca7eaaa tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:40.099460 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-44d689ed-e5ef-4126-aef6-c48d1ca7eaaa tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1215 microversion: 2.1 time: 0.420436 Sep 13 06:37:40.100175 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 13/39] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:39 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1215 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:40.115425 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-34769cfd-2b1d-463d-ae9d-d67285ecc332 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:40.115425 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-34769cfd-2b1d-463d-ae9d-d67285ecc332 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:40.153610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c5326e04-3fe1-4366-8c8a-43f98453c0bc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:40.170308 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c5326e04-3fe1-4366-8c8a-43f98453c0bc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1236 microversion: 2.1 time: 0.285348 Sep 13 06:37:40.172650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 27/40] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:39 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1236 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:40.183981 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-18a75ec1-c2ca-42b5-b4e6-9a8836928d08 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0d9e4f70>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:40.271773 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-18a75ec1-c2ca-42b5-b4e6-9a8836928d08 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] HTTP exception thrown: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-18a75ec1-c2ca-42b5-b4e6-9a8836928d08 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Request method failure captured: Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba HTTP/1.1 Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUeWNHA-PrsaTMX0XSg0eNGkIKGCKsnnm3FEZ-DIQnp7RaWnF1X_BrnKiYpQz_I1LLRb2fWAtO9WZo24cU-F1Ez7hWT9vvrm1mXYu9_xjVveaUtj76hQAt-4t1dAzW6GsPellOryWYgJ4XYT-4le_BN8Gmek-oqFQOmNYzQURv_EBY Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: cb28003c92114e8cb12c1f9525cefc6f Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:37:40.276632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: cb28003c92114e8cb12c1f9525cefc6f Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesSnapshotsTestJSON-365706033-project Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 18ab3f0478b04bfba7a54ed638b047a6 Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesSnapshotsTestJSON-365706033-project Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'e52d40e5-efa1-4fc7-96ca-d6ff09c183ba'} Sep 13 06:37:40.277769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. (HTTP 404) (Request-ID: req-671dc49c-4583-4db7-a56b-4ca684bf965e) Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:40.278424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 06:37:40.279461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 06:37:40.280622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.282140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.285486 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-18a75ec1-c2ca-42b5-b4e6-9a8836928d08 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Returning 404 to user: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:37:40.286843 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-18a75ec1-c2ca-42b5-b4e6-9a8836928d08 tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba" status: 404 len: 109 microversion: 2.1 time: 0.111070 Sep 13 06:37:40.287711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 28/41] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:37:40 2022] GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:37:40.345831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0e0244af-4b69-4f9b-a70e-d94933060f4d tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0d9e4af0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:40.452402 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-0e0244af-4b69-4f9b-a70e-d94933060f4d tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] HTTP exception thrown: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0e0244af-4b69-4f9b-a70e-d94933060f4d tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Request method failure captured: Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: DELETE /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba HTTP/1.1 Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUeWNHA-PrsaTMX0XSg0eNGkIKGCKsnnm3FEZ-DIQnp7RaWnF1X_BrnKiYpQz_I1LLRb2fWAtO9WZo24cU-F1Ez7hWT9vvrm1mXYu9_xjVveaUtj76hQAt-4t1dAzW6GsPellOryWYgJ4XYT-4le_BN8Gmek-oqFQOmNYzQURv_EBY Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: cb28003c92114e8cb12c1f9525cefc6f Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:37:40.455640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: cb28003c92114e8cb12c1f9525cefc6f Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesSnapshotsTestJSON-365706033-project Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 18ab3f0478b04bfba7a54ed638b047a6 Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesSnapshotsTestJSON-365706033-project Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'e52d40e5-efa1-4fc7-96ca-d6ff09c183ba'} Sep 13 06:37:40.456784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. (HTTP 404) (Request-ID: req-75ec8628-6d47-4112-8760-641466b23826) Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:40.457450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 06:37:40.458496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 06:37:40.460808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.462980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.466612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0e0244af-4b69-4f9b-a70e-d94933060f4d tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Returning 404 to user: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:37:40.467882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0e0244af-4b69-4f9b-a70e-d94933060f4d tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba" status: 404 len: 109 microversion: 2.1 time: 0.161857 Sep 13 06:37:40.469677 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 29/42] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Sep 13 06:37:40 2022] DELETE /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba => generated 109 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:37:40.488151 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5e41ad4f-73f8-4c81-8efd-d193ffd1226c tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Calling method '.version_select at 0x7fdc0d9dd1f0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:40.563489 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-5e41ad4f-73f8-4c81-8efd-d193ffd1226c tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] HTTP exception thrown: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5e41ad4f-73f8-4c81-8efd-d193ffd1226c tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Request method failure captured: Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba HTTP/1.1 Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUeWNHA-PrsaTMX0XSg0eNGkIKGCKsnnm3FEZ-DIQnp7RaWnF1X_BrnKiYpQz_I1LLRb2fWAtO9WZo24cU-F1Ez7hWT9vvrm1mXYu9_xjVveaUtj76hQAt-4t1dAzW6GsPellOryWYgJ4XYT-4le_BN8Gmek-oqFQOmNYzQURv_EBY Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: cb28003c92114e8cb12c1f9525cefc6f Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:37:40.565756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cb28003c92114e8cb12c1f9525cefc6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: cb28003c92114e8cb12c1f9525cefc6f Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-365706033 Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesSnapshotsTestJSON-365706033-project Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 18ab3f0478b04bfba7a54ed638b047a6 Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesSnapshotsTestJSON-365706033-project Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'e52d40e5-efa1-4fc7-96ca-d6ff09c183ba'} Sep 13 06:37:40.566917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. (HTTP 404) (Request-ID: req-632f6167-1b7f-4553-88c7-e14edc3c39ab) Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:40.567604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 06:37:40.568545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 06:37:40.569490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. Sep 13 06:37:40.570407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:37:40.573689 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5e41ad4f-73f8-4c81-8efd-d193ffd1226c tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] Returning 404 to user: Volume e52d40e5-efa1-4fc7-96ca-d6ff09c183ba could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:37:40.575966 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5e41ad4f-73f8-4c81-8efd-d193ffd1226c tempest-VolumesSnapshotsTestJSON-365706033 tempest-VolumesSnapshotsTestJSON-365706033-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba" status: 404 len: 109 microversion: 2.1 time: 0.102156 Sep 13 06:37:40.577559 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 30/43] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:37:40 2022] GET /compute/v2.1/os-volumes/e52d40e5-efa1-4fc7-96ca-d6ff09c183ba => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 06:37:40.637709 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-34769cfd-2b1d-463d-ae9d-d67285ecc332 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:40.653324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-34769cfd-2b1d-463d-ae9d-d67285ecc332 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1222 microversion: 2.1 time: 0.550532 Sep 13 06:37:40.654906 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 14/44] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:40 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1222 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:41.066906 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-661694773", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:41.126802 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-741d564f-2459-4910-b21e-7fd104e74535 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:41.127674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-741d564f-2459-4910-b21e-7fd104e74535 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:41.139649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-741d564f-2459-4910-b21e-7fd104e74535 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:41.142379 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-741d564f-2459-4910-b21e-7fd104e74535 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:41.143013 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-741d564f-2459-4910-b21e-7fd104e74535 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:41.146807 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-741d564f-2459-4910-b21e-7fd104e74535 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:41.149398 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-741d564f-2459-4910-b21e-7fd104e74535 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:41.153526 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-741d564f-2459-4910-b21e-7fd104e74535 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:41.236528 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] validate_networks() for [('8ea4fb14-b1a8-4860-a583-c1a571d4625e', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:37:41.569966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-741d564f-2459-4910-b21e-7fd104e74535 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:41.601921 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-741d564f-2459-4910-b21e-7fd104e74535 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1219 microversion: 2.1 time: 0.481355 Sep 13 06:37:41.602534 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 15/45] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:41 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1219 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:41.620714 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-dffaf976-3023-4792-8b9e-68306a5e7ed9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:41.621530 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-dffaf976-3023-4792-8b9e-68306a5e7ed9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:41.651282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dffaf976-3023-4792-8b9e-68306a5e7ed9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:41.651997 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dffaf976-3023-4792-8b9e-68306a5e7ed9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:41.660514 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dffaf976-3023-4792-8b9e-68306a5e7ed9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:41.665420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dffaf976-3023-4792-8b9e-68306a5e7ed9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:41.668566 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dffaf976-3023-4792-8b9e-68306a5e7ed9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:41.669612 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dffaf976-3023-4792-8b9e-68306a5e7ed9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:42.071174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-dffaf976-3023-4792-8b9e-68306a5e7ed9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:42.080715 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-dffaf976-3023-4792-8b9e-68306a5e7ed9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1240 microversion: 2.1 time: 0.476150 Sep 13 06:37:42.090732 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 16/46] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:41 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1240 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:42.631276 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d51fdce5-cad3-478b-8d97-b3c557ba4f76 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:42.632632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d51fdce5-cad3-478b-8d97-b3c557ba4f76 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:42.649197 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d51fdce5-cad3-478b-8d97-b3c557ba4f76 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:42.649951 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d51fdce5-cad3-478b-8d97-b3c557ba4f76 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:42.650553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d51fdce5-cad3-478b-8d97-b3c557ba4f76 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:42.651916 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d51fdce5-cad3-478b-8d97-b3c557ba4f76 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:42.653879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d51fdce5-cad3-478b-8d97-b3c557ba4f76 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:42.655535 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d51fdce5-cad3-478b-8d97-b3c557ba4f76 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:42.895286 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d51fdce5-cad3-478b-8d97-b3c557ba4f76 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:42.914021 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d51fdce5-cad3-478b-8d97-b3c557ba4f76 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1267 microversion: 2.1 time: 0.287581 Sep 13 06:37:42.917702 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 17/47] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:42 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:37:42.974555 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:37:42.975011 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:37:42.975503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:37:42.975908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:37:42.976329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:37:42.994274 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:42.997718 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:42.999702 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:43.001181 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:43.001646 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:43.002126 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:43.080467 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Getting quotas for project 2a2a801692c84c34b713aca165f69761. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:37:43.097585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Getting quotas for user 3a0a80a54cdc4107a508ca480b992319 and project 2a2a801692c84c34b713aca165f69761. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:37:43.121580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-de508a22-0b63-42ff-9ea1-01d1267e6392 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:43.122410 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-de508a22-0b63-42ff-9ea1-01d1267e6392 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:43.139481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de508a22-0b63-42ff-9ea1-01d1267e6392 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:43.141349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de508a22-0b63-42ff-9ea1-01d1267e6392 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:43.142864 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de508a22-0b63-42ff-9ea1-01d1267e6392 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:43.144364 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de508a22-0b63-42ff-9ea1-01d1267e6392 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:43.145667 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de508a22-0b63-42ff-9ea1-01d1267e6392 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:43.147152 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de508a22-0b63-42ff-9ea1-01d1267e6392 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:43.149948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:37:43.152168 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:37:43.256274 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-418afae3-d5c1-4b02-b27e-cfd816b73e3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.196339 Sep 13 06:37:43.267731 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 31/48] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:37:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:37:43.273373 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fe40709d-e17f-4009-8a98-36ff207c8faf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:43.273995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fe40709d-e17f-4009-8a98-36ff207c8faf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:43.342564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-de508a22-0b63-42ff-9ea1-01d1267e6392 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:43.352376 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-de508a22-0b63-42ff-9ea1-01d1267e6392 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1232 microversion: 2.1 time: 0.240619 Sep 13 06:37:43.358334 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 18/49] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:43 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1232 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:43.455593 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fe40709d-e17f-4009-8a98-36ff207c8faf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:43.473356 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fe40709d-e17f-4009-8a98-36ff207c8faf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1221 microversion: 2.1 time: 0.204421 Sep 13 06:37:43.479161 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 32/50] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:43 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1221 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:43.945826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-cde8ea7b-de96-4b25-a9ea-d6f77ddfb222 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:43.949296 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-cde8ea7b-de96-4b25-a9ea-d6f77ddfb222 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:43.963281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cde8ea7b-de96-4b25-a9ea-d6f77ddfb222 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:43.973065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cde8ea7b-de96-4b25-a9ea-d6f77ddfb222 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:43.976809 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cde8ea7b-de96-4b25-a9ea-d6f77ddfb222 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:43.980275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cde8ea7b-de96-4b25-a9ea-d6f77ddfb222 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:43.983788 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cde8ea7b-de96-4b25-a9ea-d6f77ddfb222 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:43.984411 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cde8ea7b-de96-4b25-a9ea-d6f77ddfb222 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:44.378897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-cde8ea7b-de96-4b25-a9ea-d6f77ddfb222 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:44.388389 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0e7a7e52-7354-4ea9-9bfd-17695dd4cd10 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:44.395465 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0e7a7e52-7354-4ea9-9bfd-17695dd4cd10 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:44.415278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-cde8ea7b-de96-4b25-a9ea-d6f77ddfb222 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1273 microversion: 2.1 time: 0.479327 Sep 13 06:37:44.417362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7a7e52-7354-4ea9-9bfd-17695dd4cd10 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:44.417489 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 19/51] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:43 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1273 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:44.418632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7a7e52-7354-4ea9-9bfd-17695dd4cd10 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:44.419119 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7a7e52-7354-4ea9-9bfd-17695dd4cd10 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:44.419896 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7a7e52-7354-4ea9-9bfd-17695dd4cd10 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:44.420454 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7a7e52-7354-4ea9-9bfd-17695dd4cd10 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:44.422573 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7a7e52-7354-4ea9-9bfd-17695dd4cd10 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:44.510173 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a0912f81-fbea-49ae-908a-5dc0fb02f06e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:44.510836 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a0912f81-fbea-49ae-908a-5dc0fb02f06e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:44.548646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0912f81-fbea-49ae-908a-5dc0fb02f06e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:44.549167 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0912f81-fbea-49ae-908a-5dc0fb02f06e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:44.549622 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0912f81-fbea-49ae-908a-5dc0fb02f06e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:44.558072 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0912f81-fbea-49ae-908a-5dc0fb02f06e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:44.560700 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0912f81-fbea-49ae-908a-5dc0fb02f06e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:44.562890 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0912f81-fbea-49ae-908a-5dc0fb02f06e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:45.210442 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a0912f81-fbea-49ae-908a-5dc0fb02f06e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:45.228749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a0912f81-fbea-49ae-908a-5dc0fb02f06e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1225 microversion: 2.1 time: 0.721182 Sep 13 06:37:45.229535 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 20/52] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:44 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1225 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:45.337214 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0e7a7e52-7354-4ea9-9bfd-17695dd4cd10 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:45.366064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0e7a7e52-7354-4ea9-9bfd-17695dd4cd10 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1288 microversion: 2.1 time: 0.982877 Sep 13 06:37:45.376957 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 33/53] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:44 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1288 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:45.453352 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-36894076-3b5d-4650-89de-f2e87d5c7604 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:45.454231 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-36894076-3b5d-4650-89de-f2e87d5c7604 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:45.465588 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36894076-3b5d-4650-89de-f2e87d5c7604 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:45.467382 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36894076-3b5d-4650-89de-f2e87d5c7604 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:45.469432 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36894076-3b5d-4650-89de-f2e87d5c7604 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:45.470446 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36894076-3b5d-4650-89de-f2e87d5c7604 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:45.472162 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36894076-3b5d-4650-89de-f2e87d5c7604 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:45.473078 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36894076-3b5d-4650-89de-f2e87d5c7604 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:45.656459 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-36894076-3b5d-4650-89de-f2e87d5c7604 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:45.668982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-36894076-3b5d-4650-89de-f2e87d5c7604 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1273 microversion: 2.1 time: 0.219901 Sep 13 06:37:45.670284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 21/54] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:45 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:46.256372 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7fbbfe59-0dbd-4683-a6a6-1a030c47da79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:46.256372 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7fbbfe59-0dbd-4683-a6a6-1a030c47da79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:46.279188 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7fbbfe59-0dbd-4683-a6a6-1a030c47da79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:46.283718 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7fbbfe59-0dbd-4683-a6a6-1a030c47da79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:46.286751 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7fbbfe59-0dbd-4683-a6a6-1a030c47da79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:46.287810 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7fbbfe59-0dbd-4683-a6a6-1a030c47da79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:46.288328 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7fbbfe59-0dbd-4683-a6a6-1a030c47da79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:46.307185 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7fbbfe59-0dbd-4683-a6a6-1a030c47da79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:46.397223 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3f1f97a8-813f-4e30-93ec-d13ccb9f8d24 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:46.399731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3f1f97a8-813f-4e30-93ec-d13ccb9f8d24 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:46.413630 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f1f97a8-813f-4e30-93ec-d13ccb9f8d24 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:46.417011 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f1f97a8-813f-4e30-93ec-d13ccb9f8d24 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:46.418479 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f1f97a8-813f-4e30-93ec-d13ccb9f8d24 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:46.419865 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f1f97a8-813f-4e30-93ec-d13ccb9f8d24 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:46.421458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f1f97a8-813f-4e30-93ec-d13ccb9f8d24 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:46.423925 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f1f97a8-813f-4e30-93ec-d13ccb9f8d24 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:46.714464 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3f1f97a8-813f-4e30-93ec-d13ccb9f8d24 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:46.739965 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3f1f97a8-813f-4e30-93ec-d13ccb9f8d24 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1294 microversion: 2.1 time: 0.342535 Sep 13 06:37:46.745169 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 22/55] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:46 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1294 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:37:46.773129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5b98d85a-f989-4960-92ad-8f2d6a4b3828 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:46.779075 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5b98d85a-f989-4960-92ad-8f2d6a4b3828 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:46.810327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b98d85a-f989-4960-92ad-8f2d6a4b3828 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:46.811451 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b98d85a-f989-4960-92ad-8f2d6a4b3828 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:46.812141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b98d85a-f989-4960-92ad-8f2d6a4b3828 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:46.816337 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b98d85a-f989-4960-92ad-8f2d6a4b3828 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:46.817306 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b98d85a-f989-4960-92ad-8f2d6a4b3828 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:46.818109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b98d85a-f989-4960-92ad-8f2d6a4b3828 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:47.252961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5b98d85a-f989-4960-92ad-8f2d6a4b3828 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:47.264828 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5b98d85a-f989-4960-92ad-8f2d6a4b3828 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1273 microversion: 2.1 time: 0.515800 Sep 13 06:37:47.269557 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 23/56] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:46 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1273 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:47.291636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1234044520", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "490d7309-ad3e-4bc6-9625-e6996e2b80d7"}], "security_groups": [{"name": "tempest-securitygroup--1541009456"}], "key_name": "tempest-keypair-1883974686", "user_data": "}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:47.484870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7fbbfe59-0dbd-4683-a6a6-1a030c47da79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:47.501961 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7fbbfe59-0dbd-4683-a6a6-1a030c47da79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1281 microversion: 2.1 time: 1.249578 Sep 13 06:37:47.504563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 34/57] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:46 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1281 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:37:47.718521 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.network.neutron [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] validate_networks() for [('490d7309-ad3e-4bc6-9625-e6996e2b80d7', None, None, None, None, None)] {{(pid=132399) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:37:47.767044 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f3a4cd7c-9da4-4bfe-84fd-9e4a587a54c1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:47.768172 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f3a4cd7c-9da4-4bfe-84fd-9e4a587a54c1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:47.777403 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3a4cd7c-9da4-4bfe-84fd-9e4a587a54c1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:47.796439 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3a4cd7c-9da4-4bfe-84fd-9e4a587a54c1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:47.796600 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3a4cd7c-9da4-4bfe-84fd-9e4a587a54c1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:47.797605 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3a4cd7c-9da4-4bfe-84fd-9e4a587a54c1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:47.798378 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3a4cd7c-9da4-4bfe-84fd-9e4a587a54c1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:47.798952 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3a4cd7c-9da4-4bfe-84fd-9e4a587a54c1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:48.352869 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f3a4cd7c-9da4-4bfe-84fd-9e4a587a54c1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:48.369585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f3a4cd7c-9da4-4bfe-84fd-9e4a587a54c1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1294 microversion: 2.1 time: 0.606650 Sep 13 06:37:48.370725 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 35/58] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:47 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1294 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:37:48.375578 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7d9d05ab-98cf-428a-bfc8-7c9c5a0457f2 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:48.381956 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7d9d05ab-98cf-428a-bfc8-7c9c5a0457f2 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:48.406065 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d9d05ab-98cf-428a-bfc8-7c9c5a0457f2 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:48.407507 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d9d05ab-98cf-428a-bfc8-7c9c5a0457f2 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:48.408142 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d9d05ab-98cf-428a-bfc8-7c9c5a0457f2 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:48.409048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d9d05ab-98cf-428a-bfc8-7c9c5a0457f2 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:48.411086 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d9d05ab-98cf-428a-bfc8-7c9c5a0457f2 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:48.411805 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d9d05ab-98cf-428a-bfc8-7c9c5a0457f2 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:48.797632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7d9d05ab-98cf-428a-bfc8-7c9c5a0457f2 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:48.842281 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7d9d05ab-98cf-428a-bfc8-7c9c5a0457f2 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1273 microversion: 2.1 time: 0.470114 Sep 13 06:37:48.850410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 36/59] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:48 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1273 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:48.872916 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c96d643e-175a-4c98-a835-7ed6926f5f9b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:48.875710 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c96d643e-175a-4c98-a835-7ed6926f5f9b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:48.890291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c96d643e-175a-4c98-a835-7ed6926f5f9b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:48.894252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c96d643e-175a-4c98-a835-7ed6926f5f9b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:48.895768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c96d643e-175a-4c98-a835-7ed6926f5f9b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:48.902013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c96d643e-175a-4c98-a835-7ed6926f5f9b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:48.902013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c96d643e-175a-4c98-a835-7ed6926f5f9b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:48.902013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c96d643e-175a-4c98-a835-7ed6926f5f9b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:49.058436 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Flavor limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:37:49.058893 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Image limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:37:49.059396 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Flavor pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:37:49.059867 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Image pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:37:49.060300 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:37:49.083185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:49.083749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:49.097294 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:49.103644 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:49.106463 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:49.106875 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:49.193822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:37:49.205081 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for user cac2d22d853a4984b229911bde3a450b and project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:37:49.245266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Going to run 1 instances... {{(pid=132399) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:37:49.251917 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:37:49.449960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7a5ca04f-15e2-4b84-9393-45b727bf433a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.175835 Sep 13 06:37:49.458975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 24/60] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:37:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:37:49.479524 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-00d9e93f-78b6-4494-b00a-e4120956ddfa tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:49.480587 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-00d9e93f-78b6-4494-b00a-e4120956ddfa tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:49.535649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-00d9e93f-78b6-4494-b00a-e4120956ddfa tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:49.539061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-00d9e93f-78b6-4494-b00a-e4120956ddfa tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:49.540825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-00d9e93f-78b6-4494-b00a-e4120956ddfa tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:49.553345 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-00d9e93f-78b6-4494-b00a-e4120956ddfa tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:49.554509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-00d9e93f-78b6-4494-b00a-e4120956ddfa tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:49.555879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-00d9e93f-78b6-4494-b00a-e4120956ddfa tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:50.136608 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c96d643e-175a-4c98-a835-7ed6926f5f9b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:50.152125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c96d643e-175a-4c98-a835-7ed6926f5f9b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1279 microversion: 2.1 time: 1.298012 Sep 13 06:37:50.153673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 37/61] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:48 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1279 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:50.177329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3f08552c-c0bc-4432-8200-310b841be824 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:50.182261 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3f08552c-c0bc-4432-8200-310b841be824 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:50.440962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-00d9e93f-78b6-4494-b00a-e4120956ddfa tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:50.464580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-00d9e93f-78b6-4494-b00a-e4120956ddfa tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.992485 Sep 13 06:37:50.465564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 25/62] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:49 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:50.495750 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d8f3f5be-88ab-492e-8fb6-9a6a5b5192ef tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:50.498362 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d8f3f5be-88ab-492e-8fb6-9a6a5b5192ef tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:50.522572 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8f3f5be-88ab-492e-8fb6-9a6a5b5192ef tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:50.524082 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8f3f5be-88ab-492e-8fb6-9a6a5b5192ef tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:50.525949 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8f3f5be-88ab-492e-8fb6-9a6a5b5192ef tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:50.526687 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8f3f5be-88ab-492e-8fb6-9a6a5b5192ef tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:50.527143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8f3f5be-88ab-492e-8fb6-9a6a5b5192ef tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:50.529981 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8f3f5be-88ab-492e-8fb6-9a6a5b5192ef tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:50.861600 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d8f3f5be-88ab-492e-8fb6-9a6a5b5192ef tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:50.870864 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d8f3f5be-88ab-492e-8fb6-9a6a5b5192ef tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.401909 Sep 13 06:37:50.872231 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 26/63] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:50 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:50.945302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3f08552c-c0bc-4432-8200-310b841be824 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:50.954103 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3f08552c-c0bc-4432-8200-310b841be824 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1242 microversion: 2.1 time: 0.797040 Sep 13 06:37:50.958006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 38/64] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:50 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1242 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:51.186121 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6c78f66c-7c80-46c6-b7b9-fd4da3f19ae3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:51.186960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6c78f66c-7c80-46c6-b7b9-fd4da3f19ae3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:51.197050 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c78f66c-7c80-46c6-b7b9-fd4da3f19ae3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:51.202398 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c78f66c-7c80-46c6-b7b9-fd4da3f19ae3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:51.209068 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c78f66c-7c80-46c6-b7b9-fd4da3f19ae3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:51.211985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c78f66c-7c80-46c6-b7b9-fd4da3f19ae3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:51.212701 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c78f66c-7c80-46c6-b7b9-fd4da3f19ae3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:51.215075 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c78f66c-7c80-46c6-b7b9-fd4da3f19ae3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:51.490477 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e37bf98c-cd6c-4c7e-80be-e40faf764909 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:51.491814 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e37bf98c-cd6c-4c7e-80be-e40faf764909 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:51.499472 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e37bf98c-cd6c-4c7e-80be-e40faf764909 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:51.505814 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e37bf98c-cd6c-4c7e-80be-e40faf764909 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:51.506794 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e37bf98c-cd6c-4c7e-80be-e40faf764909 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:51.511246 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e37bf98c-cd6c-4c7e-80be-e40faf764909 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:51.519622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e37bf98c-cd6c-4c7e-80be-e40faf764909 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:51.520494 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e37bf98c-cd6c-4c7e-80be-e40faf764909 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:52.092619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6c78f66c-7c80-46c6-b7b9-fd4da3f19ae3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:52.137910 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6c78f66c-7c80-46c6-b7b9-fd4da3f19ae3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1279 microversion: 2.1 time: 0.949809 Sep 13 06:37:52.138405 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 27/65] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:51 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1279 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:52.165802 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-db7f563d-5674-4a3b-b73b-29e7f9fac7a4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:52.169792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-db7f563d-5674-4a3b-b73b-29e7f9fac7a4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:52.187653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db7f563d-5674-4a3b-b73b-29e7f9fac7a4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:52.191316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db7f563d-5674-4a3b-b73b-29e7f9fac7a4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:52.192800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db7f563d-5674-4a3b-b73b-29e7f9fac7a4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:52.194911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db7f563d-5674-4a3b-b73b-29e7f9fac7a4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:52.197658 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db7f563d-5674-4a3b-b73b-29e7f9fac7a4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:52.199049 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db7f563d-5674-4a3b-b73b-29e7f9fac7a4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:53.025141 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=4 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:53.025787 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-db7f563d-5674-4a3b-b73b-29e7f9fac7a4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:53.037215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-db7f563d-5674-4a3b-b73b-29e7f9fac7a4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.892777 Sep 13 06:37:53.037802 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 28/66] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:52 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:53.052339 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e371f3d0-ad75-4b66-b07f-ead7ff9b0213 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:53.067165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e371f3d0-ad75-4b66-b07f-ead7ff9b0213 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:53.090181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e371f3d0-ad75-4b66-b07f-ead7ff9b0213 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:53.094705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e371f3d0-ad75-4b66-b07f-ead7ff9b0213 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:53.096964 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e371f3d0-ad75-4b66-b07f-ead7ff9b0213 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:53.097799 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e371f3d0-ad75-4b66-b07f-ead7ff9b0213 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:53.098279 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e371f3d0-ad75-4b66-b07f-ead7ff9b0213 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:53.098734 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e371f3d0-ad75-4b66-b07f-ead7ff9b0213 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:53.327540 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e371f3d0-ad75-4b66-b07f-ead7ff9b0213 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:53.336693 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e371f3d0-ad75-4b66-b07f-ead7ff9b0213 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1294 microversion: 2.1 time: 0.288071 Sep 13 06:37:53.341377 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 29/67] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:53 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1294 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:53.352437 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5b14e8b8-2de3-41da-842a-848b0e28b565 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:53.353363 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5b14e8b8-2de3-41da-842a-848b0e28b565 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:53.363848 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:53.370473 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b14e8b8-2de3-41da-842a-848b0e28b565 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:53.372320 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b14e8b8-2de3-41da-842a-848b0e28b565 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:53.373834 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b14e8b8-2de3-41da-842a-848b0e28b565 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:53.375626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b14e8b8-2de3-41da-842a-848b0e28b565 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:53.376912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b14e8b8-2de3-41da-842a-848b0e28b565 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:53.378202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b14e8b8-2de3-41da-842a-848b0e28b565 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:53.862148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e37bf98c-cd6c-4c7e-80be-e40faf764909 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:53.877818 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e37bf98c-cd6c-4c7e-80be-e40faf764909 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 2.389877 Sep 13 06:37:53.905217 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 39/68] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:51 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:37:54.020950 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5b14e8b8-2de3-41da-842a-848b0e28b565 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:54.038213 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5b14e8b8-2de3-41da-842a-848b0e28b565 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.688166 Sep 13 06:37:54.041976 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 30/69] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:53 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:54.066283 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-34cb3098-1085-4f02-b398-252a1b2d69c4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:54.068177 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-34cb3098-1085-4f02-b398-252a1b2d69c4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:54.089461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34cb3098-1085-4f02-b398-252a1b2d69c4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:54.099458 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34cb3098-1085-4f02-b398-252a1b2d69c4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:54.101094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34cb3098-1085-4f02-b398-252a1b2d69c4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:54.102238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34cb3098-1085-4f02-b398-252a1b2d69c4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:54.102803 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34cb3098-1085-4f02-b398-252a1b2d69c4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:54.103341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34cb3098-1085-4f02-b398-252a1b2d69c4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:54.371289 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-01da2a04-0f56-498e-8807-e0a7452b51f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:54.372627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-01da2a04-0f56-498e-8807-e0a7452b51f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:54.390533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01da2a04-0f56-498e-8807-e0a7452b51f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:54.391945 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01da2a04-0f56-498e-8807-e0a7452b51f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:54.394519 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01da2a04-0f56-498e-8807-e0a7452b51f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:54.395491 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01da2a04-0f56-498e-8807-e0a7452b51f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:54.396314 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01da2a04-0f56-498e-8807-e0a7452b51f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:54.398887 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01da2a04-0f56-498e-8807-e0a7452b51f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:54.494830 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:54.682237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-01da2a04-0f56-498e-8807-e0a7452b51f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:54.694175 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-01da2a04-0f56-498e-8807-e0a7452b51f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1300 microversion: 2.1 time: 0.328056 Sep 13 06:37:54.694855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 31/70] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:54 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1300 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:37:54.944811 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-34cb3098-1085-4f02-b398-252a1b2d69c4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:54.974891 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-34cb3098-1085-4f02-b398-252a1b2d69c4 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.910424 Sep 13 06:37:54.984648 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 40/71] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:54 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:55.016825 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-cfc4cada-8e6c-43af-82b0-c5e989e5628d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:55.022380 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-cfc4cada-8e6c-43af-82b0-c5e989e5628d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:55.061791 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cfc4cada-8e6c-43af-82b0-c5e989e5628d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:55.064807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cfc4cada-8e6c-43af-82b0-c5e989e5628d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:55.066307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cfc4cada-8e6c-43af-82b0-c5e989e5628d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:55.077035 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cfc4cada-8e6c-43af-82b0-c5e989e5628d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:55.078001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cfc4cada-8e6c-43af-82b0-c5e989e5628d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:55.083422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cfc4cada-8e6c-43af-82b0-c5e989e5628d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:55.338878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-0580dee6-6bb3-4fbd-95f9-a4f75386b205 req-5ade879f-2430-4b01-88c6-3183d95f6612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e145800-524d-4430-b95f-aff5b2719b66", "tag": "f7108ccd-a719-43b7-9171-8b580de3d99d"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:55.362248 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0580dee6-6bb3-4fbd-95f9-a4f75386b205 req-5ade879f-2430-4b01-88c6-3183d95f6612 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:55.365396 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0580dee6-6bb3-4fbd-95f9-a4f75386b205 req-5ade879f-2430-4b01-88c6-3183d95f6612 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:55.366069 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0580dee6-6bb3-4fbd-95f9-a4f75386b205 req-5ade879f-2430-4b01-88c6-3183d95f6612 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:55.402368 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-0580dee6-6bb3-4fbd-95f9-a4f75386b205 req-5ade879f-2430-4b01-88c6-3183d95f6612 service nova] Creating event network-changed:f7108ccd-a719-43b7-9171-8b580de3d99d for instance 4e145800-524d-4430-b95f-aff5b2719b66 on hv-cinder-85638 Sep 13 06:37:55.403891 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0580dee6-6bb3-4fbd-95f9-a4f75386b205 req-5ade879f-2430-4b01-88c6-3183d95f6612 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132399) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 06:37:55.404451 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0580dee6-6bb3-4fbd-95f9-a4f75386b205 req-5ade879f-2430-4b01-88c6-3183d95f6612 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132399) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 06:37:55.407118 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b51f6ae-bcd3-4c3c-b0bb-b416a6167a03 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:55.408608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b51f6ae-bcd3-4c3c-b0bb-b416a6167a03 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:55.409473 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b51f6ae-bcd3-4c3c-b0bb-b416a6167a03 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:55.416390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b51f6ae-bcd3-4c3c-b0bb-b416a6167a03 None None] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:55.417731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b51f6ae-bcd3-4c3c-b0bb-b416a6167a03 None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:55.419048 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b51f6ae-bcd3-4c3c-b0bb-b416a6167a03 None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:55.438839 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.compute.rpcapi [None req-5b51f6ae-bcd3-4c3c-b0bb-b416a6167a03 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 06:37:55.439799 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5b51f6ae-bcd3-4c3c-b0bb-b416a6167a03 None None] Releasing lock "compute-rpcapi-router" {{(pid=132399) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 06:37:55.475473 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5b51f6ae-bcd3-4c3c-b0bb-b416a6167a03 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.776452 Sep 13 06:37:55.476668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 32/72] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:55.483201 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-cc95f71a-e29f-4702-8583-5dbb5082d362 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:55.484242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-cc95f71a-e29f-4702-8583-5dbb5082d362 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:55.492007 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cc95f71a-e29f-4702-8583-5dbb5082d362 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:55.492877 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cc95f71a-e29f-4702-8583-5dbb5082d362 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:55.493590 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cc95f71a-e29f-4702-8583-5dbb5082d362 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:55.494480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cc95f71a-e29f-4702-8583-5dbb5082d362 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:55.495119 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cc95f71a-e29f-4702-8583-5dbb5082d362 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:55.496159 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cc95f71a-e29f-4702-8583-5dbb5082d362 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:56.405428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-cfc4cada-8e6c-43af-82b0-c5e989e5628d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:56.415376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-cfc4cada-8e6c-43af-82b0-c5e989e5628d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 1.424115 Sep 13 06:37:56.425879 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 41/73] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:54 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:56.432061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1a808866-dc5a-46d0-8c16-62701a5722fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:56.445287 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1a808866-dc5a-46d0-8c16-62701a5722fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:56.468943 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-cc95f71a-e29f-4702-8583-5dbb5082d362 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:56.477835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a808866-dc5a-46d0-8c16-62701a5722fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:56.478311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a808866-dc5a-46d0-8c16-62701a5722fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:56.478747 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a808866-dc5a-46d0-8c16-62701a5722fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:56.479504 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a808866-dc5a-46d0-8c16-62701a5722fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:56.479964 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a808866-dc5a-46d0-8c16-62701a5722fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:56.480404 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a808866-dc5a-46d0-8c16-62701a5722fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:56.482297 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-cc95f71a-e29f-4702-8583-5dbb5082d362 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 1.004203 Sep 13 06:37:56.499517 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 33/74] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:55 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:56.508152 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-616711b2-2ec7-4790-b47a-a255c305b72c tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:56.511807 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-616711b2-2ec7-4790-b47a-a255c305b72c tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:56.523749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616711b2-2ec7-4790-b47a-a255c305b72c tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:56.526741 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616711b2-2ec7-4790-b47a-a255c305b72c tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:56.527541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616711b2-2ec7-4790-b47a-a255c305b72c tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:56.528443 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616711b2-2ec7-4790-b47a-a255c305b72c tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:56.529049 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616711b2-2ec7-4790-b47a-a255c305b72c tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:56.531170 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616711b2-2ec7-4790-b47a-a255c305b72c tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:57.697992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-616711b2-2ec7-4790-b47a-a255c305b72c tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:57.709806 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-616711b2-2ec7-4790-b47a-a255c305b72c tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 1.208421 Sep 13 06:37:57.716793 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 34/75] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:56 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:57.839593 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1a808866-dc5a-46d0-8c16-62701a5722fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:57.853296 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1a808866-dc5a-46d0-8c16-62701a5722fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 1.424859 Sep 13 06:37:57.854174 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 42/76] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:56 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:57.859195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6adc9d38-9131-4dbb-93b8-c33959078ae7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:57.872295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6adc9d38-9131-4dbb-93b8-c33959078ae7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:57.879138 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6adc9d38-9131-4dbb-93b8-c33959078ae7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:57.879681 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6adc9d38-9131-4dbb-93b8-c33959078ae7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:57.880116 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6adc9d38-9131-4dbb-93b8-c33959078ae7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:57.880822 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6adc9d38-9131-4dbb-93b8-c33959078ae7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:57.881342 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6adc9d38-9131-4dbb-93b8-c33959078ae7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:57.881771 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6adc9d38-9131-4dbb-93b8-c33959078ae7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:57.988066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-dc7ff9c0-9b1a-4df9-b546-9a2790ebf5ec req-d9878b87-8c87-4c19-8cba-4e20239ebb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b78adc0-900e-4630-beef-06cd4f0ae257", "tag": "3173e994-892d-4ff5-b8b6-cc45a1a10369"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:58.003141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-dc7ff9c0-9b1a-4df9-b546-9a2790ebf5ec req-d9878b87-8c87-4c19-8cba-4e20239ebb64 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:58.006798 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-dc7ff9c0-9b1a-4df9-b546-9a2790ebf5ec req-d9878b87-8c87-4c19-8cba-4e20239ebb64 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:58.007641 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-dc7ff9c0-9b1a-4df9-b546-9a2790ebf5ec req-d9878b87-8c87-4c19-8cba-4e20239ebb64 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:58.033266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-dc7ff9c0-9b1a-4df9-b546-9a2790ebf5ec req-d9878b87-8c87-4c19-8cba-4e20239ebb64 service nova] Creating event network-changed:3173e994-892d-4ff5-b8b6-cc45a1a10369 for instance 4b78adc0-900e-4630-beef-06cd4f0ae257 on hv-cinder-85638 Sep 13 06:37:58.043412 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-dc7ff9c0-9b1a-4df9-b546-9a2790ebf5ec req-d9878b87-8c87-4c19-8cba-4e20239ebb64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325265 Sep 13 06:37:58.044333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 35/77] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:37:58.060282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9e0b8169-650c-4da7-a8c5-0c81f45ee912 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:58.061108 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9e0b8169-650c-4da7-a8c5-0c81f45ee912 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:58.073693 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e0b8169-650c-4da7-a8c5-0c81f45ee912 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:58.074465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e0b8169-650c-4da7-a8c5-0c81f45ee912 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:58.074910 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e0b8169-650c-4da7-a8c5-0c81f45ee912 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:58.075639 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e0b8169-650c-4da7-a8c5-0c81f45ee912 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:58.078831 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e0b8169-650c-4da7-a8c5-0c81f45ee912 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:58.079534 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e0b8169-650c-4da7-a8c5-0c81f45ee912 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:58.365962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9e0b8169-650c-4da7-a8c5-0c81f45ee912 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:58.388567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9e0b8169-650c-4da7-a8c5-0c81f45ee912 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.342887 Sep 13 06:37:58.408046 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 36/78] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:58 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:58.456488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6adc9d38-9131-4dbb-93b8-c33959078ae7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:58.469789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6adc9d38-9131-4dbb-93b8-c33959078ae7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.613433 Sep 13 06:37:58.470819 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 43/79] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:57 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:58.745744 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-62f38f2c-245e-47b5-ad89-97ed505bac01 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:58.746546 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-62f38f2c-245e-47b5-ad89-97ed505bac01 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:58.763024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62f38f2c-245e-47b5-ad89-97ed505bac01 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:58.765335 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62f38f2c-245e-47b5-ad89-97ed505bac01 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:58.765483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62f38f2c-245e-47b5-ad89-97ed505bac01 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:58.766175 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62f38f2c-245e-47b5-ad89-97ed505bac01 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:58.768977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62f38f2c-245e-47b5-ad89-97ed505bac01 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:58.769435 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62f38f2c-245e-47b5-ad89-97ed505bac01 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:58.770748 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-25b9b308-550a-4f79-a85a-974fea1fb93e req-49b97861-4463-4f6b-b586-59485ade086b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af9e76b-6689-431b-a4c2-2d681d4098ba", "tag": "3c3acc09-6c0d-4f36-8f12-849b52e0123f"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:37:58.788833 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-25b9b308-550a-4f79-a85a-974fea1fb93e req-49b97861-4463-4f6b-b586-59485ade086b service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:58.789302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-25b9b308-550a-4f79-a85a-974fea1fb93e req-49b97861-4463-4f6b-b586-59485ade086b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:58.789990 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-25b9b308-550a-4f79-a85a-974fea1fb93e req-49b97861-4463-4f6b-b586-59485ade086b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:58.828821 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-25b9b308-550a-4f79-a85a-974fea1fb93e req-49b97861-4463-4f6b-b586-59485ade086b service nova] Creating event network-changed:3c3acc09-6c0d-4f36-8f12-849b52e0123f for instance 1af9e76b-6689-431b-a4c2-2d681d4098ba on hv-cinder-85638 Sep 13 06:37:58.829162 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-25b9b308-550a-4f79-a85a-974fea1fb93e req-49b97861-4463-4f6b-b586-59485ade086b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132398) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 06:37:58.829556 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-25b9b308-550a-4f79-a85a-974fea1fb93e req-49b97861-4463-4f6b-b586-59485ade086b service nova] Acquired lock "compute-rpcapi-router" {{(pid=132398) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 06:37:58.830585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e6c2dd66-a4bb-44d0-9cea-0bfea2870529 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:58.831537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e6c2dd66-a4bb-44d0-9cea-0bfea2870529 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:58.832201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e6c2dd66-a4bb-44d0-9cea-0bfea2870529 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:58.833280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e6c2dd66-a4bb-44d0-9cea-0bfea2870529 None None] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:58.833889 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e6c2dd66-a4bb-44d0-9cea-0bfea2870529 None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:58.834599 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e6c2dd66-a4bb-44d0-9cea-0bfea2870529 None None] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:58.853655 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.compute.rpcapi [None req-e6c2dd66-a4bb-44d0-9cea-0bfea2870529 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 06:37:58.856420 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e6c2dd66-a4bb-44d0-9cea-0bfea2870529 None None] Releasing lock "compute-rpcapi-router" {{(pid=132398) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 06:37:58.886507 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e6c2dd66-a4bb-44d0-9cea-0bfea2870529 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119607 Sep 13 06:37:58.887286 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 44/80] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:37:58.900134 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f4505bcc-c6bc-49e3-8670-cafff20fad7d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:58.901024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f4505bcc-c6bc-49e3-8670-cafff20fad7d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:58.915508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f4505bcc-c6bc-49e3-8670-cafff20fad7d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:58.916004 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f4505bcc-c6bc-49e3-8670-cafff20fad7d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:58.916441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f4505bcc-c6bc-49e3-8670-cafff20fad7d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:58.918256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f4505bcc-c6bc-49e3-8670-cafff20fad7d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:58.918715 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f4505bcc-c6bc-49e3-8670-cafff20fad7d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:58.919140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f4505bcc-c6bc-49e3-8670-cafff20fad7d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:59.028080 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-62f38f2c-245e-47b5-ad89-97ed505bac01 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:59.041328 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-62f38f2c-245e-47b5-ad89-97ed505bac01 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.301661 Sep 13 06:37:59.052927 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 37/81] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:58 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:59.199866 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f4505bcc-c6bc-49e3-8670-cafff20fad7d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:59.211540 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f4505bcc-c6bc-49e3-8670-cafff20fad7d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.321980 Sep 13 06:37:59.228452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 45/82] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:58 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:59.416460 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8050b9d7-329c-4d7b-9dd1-aec76c8d7e7f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:59.417256 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8050b9d7-329c-4d7b-9dd1-aec76c8d7e7f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:59.419643 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=26 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:59.426963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8050b9d7-329c-4d7b-9dd1-aec76c8d7e7f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:59.427802 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8050b9d7-329c-4d7b-9dd1-aec76c8d7e7f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:59.428444 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8050b9d7-329c-4d7b-9dd1-aec76c8d7e7f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:59.431340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8050b9d7-329c-4d7b-9dd1-aec76c8d7e7f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:59.432033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8050b9d7-329c-4d7b-9dd1-aec76c8d7e7f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:59.432660 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8050b9d7-329c-4d7b-9dd1-aec76c8d7e7f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:59.497241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b815721c-519e-41f7-856f-40b7fb7659cc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:37:59.498133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b815721c-519e-41f7-856f-40b7fb7659cc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:37:59.510027 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b815721c-519e-41f7-856f-40b7fb7659cc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:59.510630 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b815721c-519e-41f7-856f-40b7fb7659cc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:59.511163 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b815721c-519e-41f7-856f-40b7fb7659cc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:59.516383 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b815721c-519e-41f7-856f-40b7fb7659cc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:37:59.517198 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b815721c-519e-41f7-856f-40b7fb7659cc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:37:59.517697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b815721c-519e-41f7-856f-40b7fb7659cc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:37:59.663683 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8050b9d7-329c-4d7b-9dd1-aec76c8d7e7f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:59.677292 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8050b9d7-329c-4d7b-9dd1-aec76c8d7e7f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.265205 Sep 13 06:37:59.679766 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 38/83] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:59 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:37:59.755650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b815721c-519e-41f7-856f-40b7fb7659cc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:37:59.765499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b815721c-519e-41f7-856f-40b7fb7659cc tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.271337 Sep 13 06:37:59.766086 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 46/84] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:37:59 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:00.087428 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9b6edc99-2118-4e56-a6cf-ecfd6125192f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:00.088031 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9b6edc99-2118-4e56-a6cf-ecfd6125192f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:00.101202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9b6edc99-2118-4e56-a6cf-ecfd6125192f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:00.101982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9b6edc99-2118-4e56-a6cf-ecfd6125192f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:00.102638 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9b6edc99-2118-4e56-a6cf-ecfd6125192f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:00.104495 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9b6edc99-2118-4e56-a6cf-ecfd6125192f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:00.105193 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9b6edc99-2118-4e56-a6cf-ecfd6125192f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:00.105998 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9b6edc99-2118-4e56-a6cf-ecfd6125192f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:00.138295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-1e3ffec8-c862-477c-a604-ae4aa395b8c7 req-7d711d2e-5b44-4969-9b7d-b33efe7e67b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9fa6279-bb1f-4dca-b762-cde8a7310fb2", "tag": "a00bdd4f-e8d5-4657-812d-5a3531fc68eb"}, {"name": "network-changed", "server_uuid": "558b2e47-a791-433b-902c-8b72a0a0e78f", "tag": "24bef117-21a5-4e33-9c7e-eae40346e83c"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:38:00.174961 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:00.185259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-1e3ffec8-c862-477c-a604-ae4aa395b8c7 req-7d711d2e-5b44-4969-9b7d-b33efe7e67b4 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:00.186169 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-1e3ffec8-c862-477c-a604-ae4aa395b8c7 req-7d711d2e-5b44-4969-9b7d-b33efe7e67b4 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:00.187654 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-1e3ffec8-c862-477c-a604-ae4aa395b8c7 req-7d711d2e-5b44-4969-9b7d-b33efe7e67b4 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:00.205670 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=81 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:00.230275 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-1e3ffec8-c862-477c-a604-ae4aa395b8c7 req-7d711d2e-5b44-4969-9b7d-b33efe7e67b4 service nova] Creating event network-changed:a00bdd4f-e8d5-4657-812d-5a3531fc68eb for instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 on hv-cinder-85638 Sep 13 06:38:00.232063 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-1e3ffec8-c862-477c-a604-ae4aa395b8c7 req-7d711d2e-5b44-4969-9b7d-b33efe7e67b4 service nova] Creating event network-changed:24bef117-21a5-4e33-9c7e-eae40346e83c for instance 558b2e47-a791-433b-902c-8b72a0a0e78f on hv-cinder-85638 Sep 13 06:38:00.238044 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-1e3ffec8-c862-477c-a604-ae4aa395b8c7 req-7d711d2e-5b44-4969-9b7d-b33efe7e67b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.103547 Sep 13 06:38:00.238925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 47/85] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:38:00.246094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5e4ac23a-a731-4df3-8c80-dd2ae7b69e80 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:00.247054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5e4ac23a-a731-4df3-8c80-dd2ae7b69e80 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:00.256627 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e4ac23a-a731-4df3-8c80-dd2ae7b69e80 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:00.257686 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e4ac23a-a731-4df3-8c80-dd2ae7b69e80 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:00.258829 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e4ac23a-a731-4df3-8c80-dd2ae7b69e80 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:00.260333 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e4ac23a-a731-4df3-8c80-dd2ae7b69e80 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:00.261017 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e4ac23a-a731-4df3-8c80-dd2ae7b69e80 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:00.261693 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e4ac23a-a731-4df3-8c80-dd2ae7b69e80 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:00.539409 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9b6edc99-2118-4e56-a6cf-ecfd6125192f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:00.559225 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9b6edc99-2118-4e56-a6cf-ecfd6125192f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.484816 Sep 13 06:38:00.559912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 39/86] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:00 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:00.632273 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5e4ac23a-a731-4df3-8c80-dd2ae7b69e80 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:00.641298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5e4ac23a-a731-4df3-8c80-dd2ae7b69e80 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.400130 Sep 13 06:38:00.642341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 48/87] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:00 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:00.707475 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-25163c07-aa2f-4a34-92be-8fd9f3724925 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:00.708661 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-25163c07-aa2f-4a34-92be-8fd9f3724925 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:00.716111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25163c07-aa2f-4a34-92be-8fd9f3724925 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:00.716610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25163c07-aa2f-4a34-92be-8fd9f3724925 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:00.717106 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25163c07-aa2f-4a34-92be-8fd9f3724925 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:00.717814 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25163c07-aa2f-4a34-92be-8fd9f3724925 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:00.718554 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25163c07-aa2f-4a34-92be-8fd9f3724925 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:00.719487 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25163c07-aa2f-4a34-92be-8fd9f3724925 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:00.788049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1c4fcb5d-a12e-436d-8f3e-08face68cfcb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:00.789018 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1c4fcb5d-a12e-436d-8f3e-08face68cfcb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:00.795417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c4fcb5d-a12e-436d-8f3e-08face68cfcb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:00.795912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c4fcb5d-a12e-436d-8f3e-08face68cfcb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:00.796346 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c4fcb5d-a12e-436d-8f3e-08face68cfcb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:00.797079 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c4fcb5d-a12e-436d-8f3e-08face68cfcb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:00.797537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c4fcb5d-a12e-436d-8f3e-08face68cfcb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:00.797963 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c4fcb5d-a12e-436d-8f3e-08face68cfcb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:00.917258 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-25163c07-aa2f-4a34-92be-8fd9f3724925 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:00.926588 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-25163c07-aa2f-4a34-92be-8fd9f3724925 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.223737 Sep 13 06:38:00.927169 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 40/88] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:00 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:00.954231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=26 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:00.966517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1c4fcb5d-a12e-436d-8f3e-08face68cfcb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:00.979237 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1c4fcb5d-a12e-436d-8f3e-08face68cfcb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.194759 Sep 13 06:38:00.979850 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 49/89] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:00 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:01.585598 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c741e94e-60c7-423f-87cb-173fef3c9963 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:01.586222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c741e94e-60c7-423f-87cb-173fef3c9963 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:01.592254 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c741e94e-60c7-423f-87cb-173fef3c9963 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:01.592739 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c741e94e-60c7-423f-87cb-173fef3c9963 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:01.593174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c741e94e-60c7-423f-87cb-173fef3c9963 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:01.593906 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c741e94e-60c7-423f-87cb-173fef3c9963 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:01.594350 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c741e94e-60c7-423f-87cb-173fef3c9963 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:01.594772 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c741e94e-60c7-423f-87cb-173fef3c9963 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:01.665299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7d91812d-6b4f-42dd-8399-45abeada4210 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:01.666432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7d91812d-6b4f-42dd-8399-45abeada4210 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:01.672983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d91812d-6b4f-42dd-8399-45abeada4210 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:01.673667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d91812d-6b4f-42dd-8399-45abeada4210 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:01.674246 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d91812d-6b4f-42dd-8399-45abeada4210 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:01.675134 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d91812d-6b4f-42dd-8399-45abeada4210 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:01.675617 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d91812d-6b4f-42dd-8399-45abeada4210 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:01.676322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d91812d-6b4f-42dd-8399-45abeada4210 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:01.756082 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c741e94e-60c7-423f-87cb-173fef3c9963 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:01.766942 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c741e94e-60c7-423f-87cb-173fef3c9963 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.186561 Sep 13 06:38:01.767781 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 41/90] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:01 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:01.829548 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7d91812d-6b4f-42dd-8399-45abeada4210 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:01.837731 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7d91812d-6b4f-42dd-8399-45abeada4210 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.176908 Sep 13 06:38:01.839241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 50/91] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:01 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:01.949198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5fc4389c-8e63-409f-88e7-6ed0bbd786d9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:01.949821 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5fc4389c-8e63-409f-88e7-6ed0bbd786d9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:01.955758 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fc4389c-8e63-409f-88e7-6ed0bbd786d9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:01.956242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fc4389c-8e63-409f-88e7-6ed0bbd786d9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:01.956680 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fc4389c-8e63-409f-88e7-6ed0bbd786d9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:01.957377 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fc4389c-8e63-409f-88e7-6ed0bbd786d9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:01.957830 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fc4389c-8e63-409f-88e7-6ed0bbd786d9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:01.958250 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fc4389c-8e63-409f-88e7-6ed0bbd786d9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:02.005735 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f79a91c6-91cc-4929-a435-93761b0c9557 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:02.006504 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f79a91c6-91cc-4929-a435-93761b0c9557 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:02.019223 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f79a91c6-91cc-4929-a435-93761b0c9557 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:02.019749 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f79a91c6-91cc-4929-a435-93761b0c9557 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:02.020181 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f79a91c6-91cc-4929-a435-93761b0c9557 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:02.020879 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f79a91c6-91cc-4929-a435-93761b0c9557 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:02.021494 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f79a91c6-91cc-4929-a435-93761b0c9557 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:02.021922 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f79a91c6-91cc-4929-a435-93761b0c9557 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:02.105261 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5fc4389c-8e63-409f-88e7-6ed0bbd786d9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:02.116908 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5fc4389c-8e63-409f-88e7-6ed0bbd786d9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.171074 Sep 13 06:38:02.136551 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 42/92] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:01 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:02.177123 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f79a91c6-91cc-4929-a435-93761b0c9557 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:02.184914 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f79a91c6-91cc-4929-a435-93761b0c9557 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.183345 Sep 13 06:38:02.185554 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 51/93] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:01 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:02.793725 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6731a986-a1d5-4aa4-bae6-619aea1364a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:02.794335 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6731a986-a1d5-4aa4-bae6-619aea1364a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:02.801046 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6731a986-a1d5-4aa4-bae6-619aea1364a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:02.801524 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6731a986-a1d5-4aa4-bae6-619aea1364a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:02.801951 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6731a986-a1d5-4aa4-bae6-619aea1364a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:02.802630 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6731a986-a1d5-4aa4-bae6-619aea1364a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:02.803080 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6731a986-a1d5-4aa4-bae6-619aea1364a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:02.803570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6731a986-a1d5-4aa4-bae6-619aea1364a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:02.864966 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-715c883f-5118-4af5-af67-8845d0fe4fca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:02.866234 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-715c883f-5118-4af5-af67-8845d0fe4fca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:02.876633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-715c883f-5118-4af5-af67-8845d0fe4fca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:02.877351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-715c883f-5118-4af5-af67-8845d0fe4fca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:02.881553 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-715c883f-5118-4af5-af67-8845d0fe4fca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:02.882692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-715c883f-5118-4af5-af67-8845d0fe4fca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:02.883297 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-715c883f-5118-4af5-af67-8845d0fe4fca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:02.883936 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-715c883f-5118-4af5-af67-8845d0fe4fca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:03.124054 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6731a986-a1d5-4aa4-bae6-619aea1364a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:03.133920 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6731a986-a1d5-4aa4-bae6-619aea1364a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.344188 Sep 13 06:38:03.135154 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 43/94] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:02 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:03.143099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-dec8410a-b640-4492-af47-b90aca114ed0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:03.143869 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-dec8410a-b640-4492-af47-b90aca114ed0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:03.150299 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dec8410a-b640-4492-af47-b90aca114ed0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:03.150957 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dec8410a-b640-4492-af47-b90aca114ed0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:03.151469 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dec8410a-b640-4492-af47-b90aca114ed0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:03.152156 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dec8410a-b640-4492-af47-b90aca114ed0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:03.152607 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dec8410a-b640-4492-af47-b90aca114ed0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:03.153024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dec8410a-b640-4492-af47-b90aca114ed0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:03.486223 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-dec8410a-b640-4492-af47-b90aca114ed0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:03.496172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-dec8410a-b640-4492-af47-b90aca114ed0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.357714 Sep 13 06:38:03.497105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 44/95] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:03 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:03.514744 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-816012ab-78b4-474c-88c0-6bc88f480cc2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:03.517288 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-816012ab-78b4-474c-88c0-6bc88f480cc2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:03.528240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-816012ab-78b4-474c-88c0-6bc88f480cc2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:03.529330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-816012ab-78b4-474c-88c0-6bc88f480cc2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:03.529947 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-816012ab-78b4-474c-88c0-6bc88f480cc2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:03.531681 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-816012ab-78b4-474c-88c0-6bc88f480cc2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:03.532352 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-816012ab-78b4-474c-88c0-6bc88f480cc2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:03.533058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-816012ab-78b4-474c-88c0-6bc88f480cc2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:03.535527 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-715c883f-5118-4af5-af67-8845d0fe4fca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:03.545615 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-715c883f-5118-4af5-af67-8845d0fe4fca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.684739 Sep 13 06:38:03.546208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 52/96] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:02 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:03.686518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-816012ab-78b4-474c-88c0-6bc88f480cc2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:03.696911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-816012ab-78b4-474c-88c0-6bc88f480cc2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.198354 Sep 13 06:38:03.714067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 45/97] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:03 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:04.157846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8ecfed49-efd9-4b32-b8b3-a99a4b3bf55b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:04.158461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8ecfed49-efd9-4b32-b8b3-a99a4b3bf55b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:04.164327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ecfed49-efd9-4b32-b8b3-a99a4b3bf55b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:04.165100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ecfed49-efd9-4b32-b8b3-a99a4b3bf55b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:04.165530 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ecfed49-efd9-4b32-b8b3-a99a4b3bf55b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:04.166227 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ecfed49-efd9-4b32-b8b3-a99a4b3bf55b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:04.166684 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ecfed49-efd9-4b32-b8b3-a99a4b3bf55b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:04.167115 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ecfed49-efd9-4b32-b8b3-a99a4b3bf55b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:04.308052 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8ecfed49-efd9-4b32-b8b3-a99a4b3bf55b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:04.315744 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8ecfed49-efd9-4b32-b8b3-a99a4b3bf55b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.162090 Sep 13 06:38:04.316309 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 53/98] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:04 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:04.520730 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7d28c48b-a9c2-4b59-bb00-5bd62e09d2fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:04.521333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7d28c48b-a9c2-4b59-bb00-5bd62e09d2fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:04.529016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7d28c48b-a9c2-4b59-bb00-5bd62e09d2fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:04.531657 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7d28c48b-a9c2-4b59-bb00-5bd62e09d2fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:04.532619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7d28c48b-a9c2-4b59-bb00-5bd62e09d2fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:04.533500 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7d28c48b-a9c2-4b59-bb00-5bd62e09d2fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:04.534100 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7d28c48b-a9c2-4b59-bb00-5bd62e09d2fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:04.534677 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7d28c48b-a9c2-4b59-bb00-5bd62e09d2fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:04.569249 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9ab59618-6e4f-4e7f-9fde-e5385c8a0f99 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:04.570200 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9ab59618-6e4f-4e7f-9fde-e5385c8a0f99 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:04.579993 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ab59618-6e4f-4e7f-9fde-e5385c8a0f99 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:04.581066 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ab59618-6e4f-4e7f-9fde-e5385c8a0f99 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:04.581812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ab59618-6e4f-4e7f-9fde-e5385c8a0f99 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:04.582653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ab59618-6e4f-4e7f-9fde-e5385c8a0f99 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:04.583236 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ab59618-6e4f-4e7f-9fde-e5385c8a0f99 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:04.583823 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ab59618-6e4f-4e7f-9fde-e5385c8a0f99 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:04.725662 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7d28c48b-a9c2-4b59-bb00-5bd62e09d2fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:04.734395 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7d28c48b-a9c2-4b59-bb00-5bd62e09d2fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.217620 Sep 13 06:38:04.734981 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 46/99] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:04 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:04.741365 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e0bd61da-2dd3-47fc-be4a-5e1e12c2bd81 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:04.743712 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e0bd61da-2dd3-47fc-be4a-5e1e12c2bd81 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:04.751938 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0bd61da-2dd3-47fc-be4a-5e1e12c2bd81 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:04.753059 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0bd61da-2dd3-47fc-be4a-5e1e12c2bd81 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:04.753666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0bd61da-2dd3-47fc-be4a-5e1e12c2bd81 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:04.755791 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0bd61da-2dd3-47fc-be4a-5e1e12c2bd81 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:04.756403 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0bd61da-2dd3-47fc-be4a-5e1e12c2bd81 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:04.757182 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0bd61da-2dd3-47fc-be4a-5e1e12c2bd81 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:04.831953 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9ab59618-6e4f-4e7f-9fde-e5385c8a0f99 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:04.854630 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9ab59618-6e4f-4e7f-9fde-e5385c8a0f99 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.289243 Sep 13 06:38:04.857704 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 54/100] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:04 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:05.045481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e0bd61da-2dd3-47fc-be4a-5e1e12c2bd81 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:05.058518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e0bd61da-2dd3-47fc-be4a-5e1e12c2bd81 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.322457 Sep 13 06:38:05.059106 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 47/101] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:04 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:05.338152 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c0b4ef0d-ef4e-4e4b-820f-310e70d48320 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:05.340247 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c0b4ef0d-ef4e-4e4b-820f-310e70d48320 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:05.356217 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c0b4ef0d-ef4e-4e4b-820f-310e70d48320 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:05.356747 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c0b4ef0d-ef4e-4e4b-820f-310e70d48320 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:05.359737 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c0b4ef0d-ef4e-4e4b-820f-310e70d48320 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:05.360493 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c0b4ef0d-ef4e-4e4b-820f-310e70d48320 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:05.360954 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c0b4ef0d-ef4e-4e4b-820f-310e70d48320 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:05.364129 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c0b4ef0d-ef4e-4e4b-820f-310e70d48320 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:05.704792 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c0b4ef0d-ef4e-4e4b-820f-310e70d48320 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:05.712654 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c0b4ef0d-ef4e-4e4b-820f-310e70d48320 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.378377 Sep 13 06:38:05.713219 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 55/102] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:05 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:05.758047 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-42d8d088-1cff-4257-83ae-b0425256f80b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:05.758579 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-42d8d088-1cff-4257-83ae-b0425256f80b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:05.760429 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=8 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:05.765719 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-42d8d088-1cff-4257-83ae-b0425256f80b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:05.766203 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-42d8d088-1cff-4257-83ae-b0425256f80b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:05.766634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-42d8d088-1cff-4257-83ae-b0425256f80b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:05.767333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-42d8d088-1cff-4257-83ae-b0425256f80b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:05.767810 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-42d8d088-1cff-4257-83ae-b0425256f80b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:05.768225 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-42d8d088-1cff-4257-83ae-b0425256f80b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:05.880174 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5ac36c35-1f91-4757-bac1-0b01f91f3978 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:05.880782 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5ac36c35-1f91-4757-bac1-0b01f91f3978 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:05.886558 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ac36c35-1f91-4757-bac1-0b01f91f3978 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:05.887042 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ac36c35-1f91-4757-bac1-0b01f91f3978 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:05.887558 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ac36c35-1f91-4757-bac1-0b01f91f3978 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:05.888253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ac36c35-1f91-4757-bac1-0b01f91f3978 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:05.888708 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ac36c35-1f91-4757-bac1-0b01f91f3978 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:05.889129 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ac36c35-1f91-4757-bac1-0b01f91f3978 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:05.895348 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-42d8d088-1cff-4257-83ae-b0425256f80b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:05.903160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-42d8d088-1cff-4257-83ae-b0425256f80b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.148995 Sep 13 06:38:05.915400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 48/103] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:05 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:06.025606 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5ac36c35-1f91-4757-bac1-0b01f91f3978 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:06.033770 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5ac36c35-1f91-4757-bac1-0b01f91f3978 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.157491 Sep 13 06:38:06.034338 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 56/104] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:05 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:06.081610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-64529491-11bb-48e5-a1cf-696a59f7b401 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:06.082252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-64529491-11bb-48e5-a1cf-696a59f7b401 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:06.089495 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64529491-11bb-48e5-a1cf-696a59f7b401 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:06.089985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64529491-11bb-48e5-a1cf-696a59f7b401 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:06.090421 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64529491-11bb-48e5-a1cf-696a59f7b401 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:06.091113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64529491-11bb-48e5-a1cf-696a59f7b401 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:06.091592 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64529491-11bb-48e5-a1cf-696a59f7b401 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:06.092170 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64529491-11bb-48e5-a1cf-696a59f7b401 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:06.097053 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:06.238806 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-64529491-11bb-48e5-a1cf-696a59f7b401 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:06.248087 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-64529491-11bb-48e5-a1cf-696a59f7b401 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.170535 Sep 13 06:38:06.248887 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 49/105] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:06 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:06.744819 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7d3c217a-7915-4a58-a417-e0759a40bb08 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:06.746446 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7d3c217a-7915-4a58-a417-e0759a40bb08 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:06.758416 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d3c217a-7915-4a58-a417-e0759a40bb08 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:06.760006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d3c217a-7915-4a58-a417-e0759a40bb08 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:06.762908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d3c217a-7915-4a58-a417-e0759a40bb08 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:06.765850 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d3c217a-7915-4a58-a417-e0759a40bb08 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:06.767078 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d3c217a-7915-4a58-a417-e0759a40bb08 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:06.768110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d3c217a-7915-4a58-a417-e0759a40bb08 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:06.928631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0624a688-cf5d-4192-8d6b-f4705064e28d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:06.929236 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0624a688-cf5d-4192-8d6b-f4705064e28d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:06.936652 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0624a688-cf5d-4192-8d6b-f4705064e28d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:06.937686 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0624a688-cf5d-4192-8d6b-f4705064e28d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:06.938119 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0624a688-cf5d-4192-8d6b-f4705064e28d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:06.938816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0624a688-cf5d-4192-8d6b-f4705064e28d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:06.939263 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0624a688-cf5d-4192-8d6b-f4705064e28d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:06.939723 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0624a688-cf5d-4192-8d6b-f4705064e28d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:07.102962 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7d3c217a-7915-4a58-a417-e0759a40bb08 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:07.110823 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0624a688-cf5d-4192-8d6b-f4705064e28d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:07.118237 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7d3c217a-7915-4a58-a417-e0759a40bb08 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.384875 Sep 13 06:38:07.118871 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 57/106] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:06 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:07.129045 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0624a688-cf5d-4192-8d6b-f4705064e28d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.204205 Sep 13 06:38:07.144057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 50/107] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:06 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:07.150932 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-620febf5-0084-4f02-9a1f-bd462e1a7fa5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:07.151810 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-620febf5-0084-4f02-9a1f-bd462e1a7fa5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:07.158011 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-620febf5-0084-4f02-9a1f-bd462e1a7fa5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:07.158509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-620febf5-0084-4f02-9a1f-bd462e1a7fa5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:07.158947 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-620febf5-0084-4f02-9a1f-bd462e1a7fa5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:07.159673 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-620febf5-0084-4f02-9a1f-bd462e1a7fa5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:07.160281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-620febf5-0084-4f02-9a1f-bd462e1a7fa5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:07.160869 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-620febf5-0084-4f02-9a1f-bd462e1a7fa5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:07.290241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-d9fb3435-6d38-492a-b6d8-8ac329ba5633 req-a067c23e-2dc9-4cb3-9b37-003bb45d9d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e145800-524d-4430-b95f-aff5b2719b66", "name": "network-vif-plugged", "status": "completed", "tag": "f7108ccd-a719-43b7-9171-8b580de3d99d"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:38:07.314675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-d9fb3435-6d38-492a-b6d8-8ac329ba5633 req-a067c23e-2dc9-4cb3-9b37-003bb45d9d13 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:07.315323 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-d9fb3435-6d38-492a-b6d8-8ac329ba5633 req-a067c23e-2dc9-4cb3-9b37-003bb45d9d13 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:07.316075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-d9fb3435-6d38-492a-b6d8-8ac329ba5633 req-a067c23e-2dc9-4cb3-9b37-003bb45d9d13 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:07.343002 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-d9fb3435-6d38-492a-b6d8-8ac329ba5633 req-a067c23e-2dc9-4cb3-9b37-003bb45d9d13 service nova] Creating event network-vif-plugged:f7108ccd-a719-43b7-9171-8b580de3d99d for instance 4e145800-524d-4430-b95f-aff5b2719b66 on hv-cinder-85638 Sep 13 06:38:07.348697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-d9fb3435-6d38-492a-b6d8-8ac329ba5633 req-a067c23e-2dc9-4cb3-9b37-003bb45d9d13 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217677 Sep 13 06:38:07.349831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 58/108] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:38:07.356513 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fec980be-3732-4474-bd1a-92cf77791e97 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:07.357212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fec980be-3732-4474-bd1a-92cf77791e97 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:07.364976 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fec980be-3732-4474-bd1a-92cf77791e97 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:07.365660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fec980be-3732-4474-bd1a-92cf77791e97 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:07.366758 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fec980be-3732-4474-bd1a-92cf77791e97 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:07.367648 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fec980be-3732-4474-bd1a-92cf77791e97 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:07.368244 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fec980be-3732-4474-bd1a-92cf77791e97 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:07.368810 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fec980be-3732-4474-bd1a-92cf77791e97 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:07.388989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-620febf5-0084-4f02-9a1f-bd462e1a7fa5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:07.397872 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-620febf5-0084-4f02-9a1f-bd462e1a7fa5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.252569 Sep 13 06:38:07.398449 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 51/109] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:07 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:07.542107 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fec980be-3732-4474-bd1a-92cf77791e97 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:07.551433 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fec980be-3732-4474-bd1a-92cf77791e97 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.199303 Sep 13 06:38:07.552431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 59/110] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:07 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:08.143661 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-107f7b06-6ab9-4249-abf8-3a12037681a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:08.144275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-107f7b06-6ab9-4249-abf8-3a12037681a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:08.152768 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107f7b06-6ab9-4249-abf8-3a12037681a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:08.153260 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107f7b06-6ab9-4249-abf8-3a12037681a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:08.153698 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107f7b06-6ab9-4249-abf8-3a12037681a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:08.154401 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107f7b06-6ab9-4249-abf8-3a12037681a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:08.154857 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107f7b06-6ab9-4249-abf8-3a12037681a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:08.155282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107f7b06-6ab9-4249-abf8-3a12037681a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:08.159235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-961243ad-80df-440e-9ac5-6256703be759 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:08.160554 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-961243ad-80df-440e-9ac5-6256703be759 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:08.168900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-961243ad-80df-440e-9ac5-6256703be759 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:08.169752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-961243ad-80df-440e-9ac5-6256703be759 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:08.170508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-961243ad-80df-440e-9ac5-6256703be759 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:08.172701 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-961243ad-80df-440e-9ac5-6256703be759 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:08.173390 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-961243ad-80df-440e-9ac5-6256703be759 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:08.174050 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-961243ad-80df-440e-9ac5-6256703be759 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:08.345138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-107f7b06-6ab9-4249-abf8-3a12037681a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:08.355461 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-107f7b06-6ab9-4249-abf8-3a12037681a0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.215431 Sep 13 06:38:08.360358 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 52/111] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:08 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:08.424429 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-54af9194-fe3f-45e0-9ddf-a6f49e6310e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:08.426521 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-54af9194-fe3f-45e0-9ddf-a6f49e6310e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:08.441280 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54af9194-fe3f-45e0-9ddf-a6f49e6310e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:08.444033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54af9194-fe3f-45e0-9ddf-a6f49e6310e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:08.445315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54af9194-fe3f-45e0-9ddf-a6f49e6310e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:08.446605 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54af9194-fe3f-45e0-9ddf-a6f49e6310e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:08.449465 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-961243ad-80df-440e-9ac5-6256703be759 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:08.449952 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54af9194-fe3f-45e0-9ddf-a6f49e6310e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:08.451744 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54af9194-fe3f-45e0-9ddf-a6f49e6310e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:08.463474 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-961243ad-80df-440e-9ac5-6256703be759 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.309737 Sep 13 06:38:08.480522 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 60/112] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:08 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:08.578727 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-57ef8c03-94a2-49b3-b65a-f1158e5d11e8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:08.579343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-57ef8c03-94a2-49b3-b65a-f1158e5d11e8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:08.590390 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-57ef8c03-94a2-49b3-b65a-f1158e5d11e8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:08.590892 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-57ef8c03-94a2-49b3-b65a-f1158e5d11e8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:08.591524 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-57ef8c03-94a2-49b3-b65a-f1158e5d11e8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:08.592550 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-57ef8c03-94a2-49b3-b65a-f1158e5d11e8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:08.594570 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-57ef8c03-94a2-49b3-b65a-f1158e5d11e8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:08.597284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-57ef8c03-94a2-49b3-b65a-f1158e5d11e8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:08.785455 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-57ef8c03-94a2-49b3-b65a-f1158e5d11e8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:08.786653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-54af9194-fe3f-45e0-9ddf-a6f49e6310e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:08.799517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-57ef8c03-94a2-49b3-b65a-f1158e5d11e8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.225123 Sep 13 06:38:08.800316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-54af9194-fe3f-45e0-9ddf-a6f49e6310e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.382092 Sep 13 06:38:08.800967 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 53/113] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:08 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:08.801979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 61/114] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:08 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:09.380402 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-13984e66-23be-43d4-8e59-7ee77b538f69 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:09.381985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-13984e66-23be-43d4-8e59-7ee77b538f69 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:09.388407 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13984e66-23be-43d4-8e59-7ee77b538f69 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:09.389285 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13984e66-23be-43d4-8e59-7ee77b538f69 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:09.389890 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13984e66-23be-43d4-8e59-7ee77b538f69 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:09.390732 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13984e66-23be-43d4-8e59-7ee77b538f69 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:09.391390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13984e66-23be-43d4-8e59-7ee77b538f69 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:09.391985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13984e66-23be-43d4-8e59-7ee77b538f69 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:09.500836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-bce6bb7a-3bad-4386-b721-69b11b216901 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:09.503429 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-bce6bb7a-3bad-4386-b721-69b11b216901 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:09.513033 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:09.516511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bce6bb7a-3bad-4386-b721-69b11b216901 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:09.517873 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bce6bb7a-3bad-4386-b721-69b11b216901 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:09.518743 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bce6bb7a-3bad-4386-b721-69b11b216901 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:09.543826 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bce6bb7a-3bad-4386-b721-69b11b216901 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:09.544551 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bce6bb7a-3bad-4386-b721-69b11b216901 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:09.549148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bce6bb7a-3bad-4386-b721-69b11b216901 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:09.637267 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-13984e66-23be-43d4-8e59-7ee77b538f69 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:09.648733 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-13984e66-23be-43d4-8e59-7ee77b538f69 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.272183 Sep 13 06:38:09.665795 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 54/115] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:09 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:09.829925 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-14428101-b5d6-4afb-abb4-2497190bf1f7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:09.830807 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-14428101-b5d6-4afb-abb4-2497190bf1f7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:09.842110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-14428101-b5d6-4afb-abb4-2497190bf1f7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:09.845066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-14428101-b5d6-4afb-abb4-2497190bf1f7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:09.845548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-14428101-b5d6-4afb-abb4-2497190bf1f7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:09.846279 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-14428101-b5d6-4afb-abb4-2497190bf1f7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:09.846739 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-14428101-b5d6-4afb-abb4-2497190bf1f7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:09.850023 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-14428101-b5d6-4afb-abb4-2497190bf1f7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:10.004189 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-bce6bb7a-3bad-4386-b721-69b11b216901 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:10.017907 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-bce6bb7a-3bad-4386-b721-69b11b216901 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.523978 Sep 13 06:38:10.020505 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 62/116] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:09 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:10.032876 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4507926d-2697-42a5-95e8-3a3678db03e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:10.036049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4507926d-2697-42a5-95e8-3a3678db03e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:10.049814 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4507926d-2697-42a5-95e8-3a3678db03e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:10.050925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4507926d-2697-42a5-95e8-3a3678db03e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:10.051643 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4507926d-2697-42a5-95e8-3a3678db03e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:10.055040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4507926d-2697-42a5-95e8-3a3678db03e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:10.056035 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4507926d-2697-42a5-95e8-3a3678db03e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:10.057694 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4507926d-2697-42a5-95e8-3a3678db03e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:10.122682 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-14428101-b5d6-4afb-abb4-2497190bf1f7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:10.130985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-14428101-b5d6-4afb-abb4-2497190bf1f7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.308991 Sep 13 06:38:10.138582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 55/117] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:09 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:10.259342 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4507926d-2697-42a5-95e8-3a3678db03e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:10.270220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4507926d-2697-42a5-95e8-3a3678db03e5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.248387 Sep 13 06:38:10.271191 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 63/118] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:10 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:10.674047 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-eed275a3-1a5c-4468-a1cb-fbe6b10bd488 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:10.674662 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-eed275a3-1a5c-4468-a1cb-fbe6b10bd488 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:10.682503 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eed275a3-1a5c-4468-a1cb-fbe6b10bd488 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:10.683092 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eed275a3-1a5c-4468-a1cb-fbe6b10bd488 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:10.685940 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eed275a3-1a5c-4468-a1cb-fbe6b10bd488 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:10.686724 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eed275a3-1a5c-4468-a1cb-fbe6b10bd488 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:10.687410 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eed275a3-1a5c-4468-a1cb-fbe6b10bd488 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:10.688025 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eed275a3-1a5c-4468-a1cb-fbe6b10bd488 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:10.862561 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-eed275a3-1a5c-4468-a1cb-fbe6b10bd488 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:10.871519 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-eed275a3-1a5c-4468-a1cb-fbe6b10bd488 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.202234 Sep 13 06:38:10.872104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 56/119] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:10 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:11.049342 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e420b8c9-22f3-4b48-9f0e-2c9b054a3c37 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:11.050374 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e420b8c9-22f3-4b48-9f0e-2c9b054a3c37 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:11.056819 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e420b8c9-22f3-4b48-9f0e-2c9b054a3c37 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:11.057372 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e420b8c9-22f3-4b48-9f0e-2c9b054a3c37 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:11.057877 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e420b8c9-22f3-4b48-9f0e-2c9b054a3c37 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:11.058787 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e420b8c9-22f3-4b48-9f0e-2c9b054a3c37 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:11.059233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e420b8c9-22f3-4b48-9f0e-2c9b054a3c37 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:11.059753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e420b8c9-22f3-4b48-9f0e-2c9b054a3c37 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:11.159861 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4e832d6d-55ce-4f53-979c-a606514a7a30 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:11.160540 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4e832d6d-55ce-4f53-979c-a606514a7a30 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:11.169886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e832d6d-55ce-4f53-979c-a606514a7a30 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:11.170426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e832d6d-55ce-4f53-979c-a606514a7a30 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:11.170800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e832d6d-55ce-4f53-979c-a606514a7a30 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:11.171589 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e832d6d-55ce-4f53-979c-a606514a7a30 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:11.172042 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e832d6d-55ce-4f53-979c-a606514a7a30 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:11.172668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e832d6d-55ce-4f53-979c-a606514a7a30 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:11.264095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e420b8c9-22f3-4b48-9f0e-2c9b054a3c37 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:11.280365 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e420b8c9-22f3-4b48-9f0e-2c9b054a3c37 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.237288 Sep 13 06:38:11.295891 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 64/120] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:11 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:11.303349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4021b30b-e1f7-4f95-b53d-9d9bebdc783f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:11.304177 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4021b30b-e1f7-4f95-b53d-9d9bebdc783f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:11.310966 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4021b30b-e1f7-4f95-b53d-9d9bebdc783f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:11.312125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4021b30b-e1f7-4f95-b53d-9d9bebdc783f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:11.312578 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4021b30b-e1f7-4f95-b53d-9d9bebdc783f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:11.313295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4021b30b-e1f7-4f95-b53d-9d9bebdc783f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:11.313755 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4021b30b-e1f7-4f95-b53d-9d9bebdc783f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:11.314231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4021b30b-e1f7-4f95-b53d-9d9bebdc783f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:11.319877 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:11.340566 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4e832d6d-55ce-4f53-979c-a606514a7a30 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:11.357777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4e832d6d-55ce-4f53-979c-a606514a7a30 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.208298 Sep 13 06:38:11.358375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 57/121] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:11 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:11.567069 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4021b30b-e1f7-4f95-b53d-9d9bebdc783f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:11.574761 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4021b30b-e1f7-4f95-b53d-9d9bebdc783f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.280916 Sep 13 06:38:11.587838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 65/122] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:11 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:11.898040 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-da748247-6291-4f24-a33e-932c0f033c0d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:11.898845 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-da748247-6291-4f24-a33e-932c0f033c0d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:11.911195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da748247-6291-4f24-a33e-932c0f033c0d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:11.911490 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da748247-6291-4f24-a33e-932c0f033c0d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:11.912648 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da748247-6291-4f24-a33e-932c0f033c0d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:11.931632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da748247-6291-4f24-a33e-932c0f033c0d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:11.936619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da748247-6291-4f24-a33e-932c0f033c0d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:11.938510 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da748247-6291-4f24-a33e-932c0f033c0d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:12.191157 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-da748247-6291-4f24-a33e-932c0f033c0d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:12.200347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-da748247-6291-4f24-a33e-932c0f033c0d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.307532 Sep 13 06:38:12.221542 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 58/123] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:11 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:12.247610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-a7fcacc3-28aa-46d2-994d-e62dd121963d req-cfc2ee34-406e-416b-be30-6ab706af295d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b78adc0-900e-4630-beef-06cd4f0ae257", "name": "network-vif-plugged", "status": "completed", "tag": "3173e994-892d-4ff5-b8b6-cc45a1a10369"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:38:12.268295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a7fcacc3-28aa-46d2-994d-e62dd121963d req-cfc2ee34-406e-416b-be30-6ab706af295d service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:12.268780 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a7fcacc3-28aa-46d2-994d-e62dd121963d req-cfc2ee34-406e-416b-be30-6ab706af295d service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:12.269206 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a7fcacc3-28aa-46d2-994d-e62dd121963d req-cfc2ee34-406e-416b-be30-6ab706af295d service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:12.291581 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-a7fcacc3-28aa-46d2-994d-e62dd121963d req-cfc2ee34-406e-416b-be30-6ab706af295d service nova] Creating event network-vif-plugged:3173e994-892d-4ff5-b8b6-cc45a1a10369 for instance 4b78adc0-900e-4630-beef-06cd4f0ae257 on hv-cinder-85638 Sep 13 06:38:12.306372 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-84162fb4-9598-4c4b-b4e6-952f972d9702 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:12.307272 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-84162fb4-9598-4c4b-b4e6-952f972d9702 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:12.327091 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84162fb4-9598-4c4b-b4e6-952f972d9702 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:12.329347 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-a7fcacc3-28aa-46d2-994d-e62dd121963d req-cfc2ee34-406e-416b-be30-6ab706af295d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085427 Sep 13 06:38:12.330045 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84162fb4-9598-4c4b-b4e6-952f972d9702 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:12.330633 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84162fb4-9598-4c4b-b4e6-952f972d9702 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:12.331567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84162fb4-9598-4c4b-b4e6-952f972d9702 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:12.332356 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 66/124] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:38:12.332989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84162fb4-9598-4c4b-b4e6-952f972d9702 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:12.333822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84162fb4-9598-4c4b-b4e6-952f972d9702 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:12.382693 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-81f4a4fa-dd74-491d-9182-8f8b4d7f001f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:12.383676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-81f4a4fa-dd74-491d-9182-8f8b4d7f001f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:12.395718 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-81f4a4fa-dd74-491d-9182-8f8b4d7f001f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:12.399643 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-81f4a4fa-dd74-491d-9182-8f8b4d7f001f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:12.400516 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-81f4a4fa-dd74-491d-9182-8f8b4d7f001f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:12.401423 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-81f4a4fa-dd74-491d-9182-8f8b4d7f001f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:12.402036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-81f4a4fa-dd74-491d-9182-8f8b4d7f001f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:12.405224 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-81f4a4fa-dd74-491d-9182-8f8b4d7f001f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:12.680779 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-84162fb4-9598-4c4b-b4e6-952f972d9702 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:12.690859 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-84162fb4-9598-4c4b-b4e6-952f972d9702 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.389220 Sep 13 06:38:12.691563 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 59/125] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:12 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:12.698046 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4c95b0bd-9c3e-47c4-b535-82efdf631b05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:12.699206 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4c95b0bd-9c3e-47c4-b535-82efdf631b05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:12.706768 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c95b0bd-9c3e-47c4-b535-82efdf631b05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:12.708239 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c95b0bd-9c3e-47c4-b535-82efdf631b05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:12.709348 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c95b0bd-9c3e-47c4-b535-82efdf631b05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:12.710974 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c95b0bd-9c3e-47c4-b535-82efdf631b05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:12.712927 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c95b0bd-9c3e-47c4-b535-82efdf631b05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:12.714783 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c95b0bd-9c3e-47c4-b535-82efdf631b05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:12.843956 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-81f4a4fa-dd74-491d-9182-8f8b4d7f001f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:12.861804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-81f4a4fa-dd74-491d-9182-8f8b4d7f001f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.480827 Sep 13 06:38:12.863185 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 67/126] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:12 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:13.025027 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4c95b0bd-9c3e-47c4-b535-82efdf631b05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:13.038463 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4c95b0bd-9c3e-47c4-b535-82efdf631b05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.345275 Sep 13 06:38:13.050028 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 60/127] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:12 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:13.228307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f6642e40-3669-4cc5-9a56-42444d45d92f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:13.229250 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f6642e40-3669-4cc5-9a56-42444d45d92f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:13.236389 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6642e40-3669-4cc5-9a56-42444d45d92f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:13.237281 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6642e40-3669-4cc5-9a56-42444d45d92f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:13.237865 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6642e40-3669-4cc5-9a56-42444d45d92f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:13.239204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6642e40-3669-4cc5-9a56-42444d45d92f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:13.240147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6642e40-3669-4cc5-9a56-42444d45d92f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:13.240548 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6642e40-3669-4cc5-9a56-42444d45d92f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:13.404741 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f6642e40-3669-4cc5-9a56-42444d45d92f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:13.413364 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f6642e40-3669-4cc5-9a56-42444d45d92f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.188994 Sep 13 06:38:13.414240 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 68/128] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:13 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:13.714390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4cf3f22c-979f-4b9b-8954-ed3975b1db86 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:13.715972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4cf3f22c-979f-4b9b-8954-ed3975b1db86 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:13.723663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4cf3f22c-979f-4b9b-8954-ed3975b1db86 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:13.724394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4cf3f22c-979f-4b9b-8954-ed3975b1db86 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:13.725418 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4cf3f22c-979f-4b9b-8954-ed3975b1db86 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:13.726491 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4cf3f22c-979f-4b9b-8954-ed3975b1db86 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:13.727186 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4cf3f22c-979f-4b9b-8954-ed3975b1db86 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:13.727920 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4cf3f22c-979f-4b9b-8954-ed3975b1db86 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:13.885600 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0e24e27f-0c3f-4097-a68b-e4aa8c4eae4e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:13.886205 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0e24e27f-0c3f-4097-a68b-e4aa8c4eae4e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:13.894706 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e24e27f-0c3f-4097-a68b-e4aa8c4eae4e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:13.895204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e24e27f-0c3f-4097-a68b-e4aa8c4eae4e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:13.895668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e24e27f-0c3f-4097-a68b-e4aa8c4eae4e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:13.897066 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e24e27f-0c3f-4097-a68b-e4aa8c4eae4e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:13.898120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e24e27f-0c3f-4097-a68b-e4aa8c4eae4e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:13.898496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e24e27f-0c3f-4097-a68b-e4aa8c4eae4e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:13.916155 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4cf3f22c-979f-4b9b-8954-ed3975b1db86 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:13.928710 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4cf3f22c-979f-4b9b-8954-ed3975b1db86 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.217203 Sep 13 06:38:13.930201 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 61/129] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:13 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:14.067299 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4b65e2f9-99a2-4445-b9a9-9c8a8f468f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:14.069381 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4b65e2f9-99a2-4445-b9a9-9c8a8f468f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:14.078183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b65e2f9-99a2-4445-b9a9-9c8a8f468f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:14.079098 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b65e2f9-99a2-4445-b9a9-9c8a8f468f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:14.079924 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b65e2f9-99a2-4445-b9a9-9c8a8f468f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:14.080970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b65e2f9-99a2-4445-b9a9-9c8a8f468f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:14.081614 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b65e2f9-99a2-4445-b9a9-9c8a8f468f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:14.082735 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b65e2f9-99a2-4445-b9a9-9c8a8f468f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:14.206657 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0e24e27f-0c3f-4097-a68b-e4aa8c4eae4e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:14.219435 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0e24e27f-0c3f-4097-a68b-e4aa8c4eae4e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.337711 Sep 13 06:38:14.220083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 69/130] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:13 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:14.342465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4b65e2f9-99a2-4445-b9a9-9c8a8f468f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:14.361660 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4b65e2f9-99a2-4445-b9a9-9c8a8f468f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.298669 Sep 13 06:38:14.362564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 62/131] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:14 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:14.437551 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-de613481-d4cb-4e85-808f-b081cc5bfeac tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:14.438398 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-de613481-d4cb-4e85-808f-b081cc5bfeac tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:14.444529 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de613481-d4cb-4e85-808f-b081cc5bfeac tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:14.450605 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de613481-d4cb-4e85-808f-b081cc5bfeac tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:14.451118 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de613481-d4cb-4e85-808f-b081cc5bfeac tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:14.453144 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de613481-d4cb-4e85-808f-b081cc5bfeac tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:14.453874 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de613481-d4cb-4e85-808f-b081cc5bfeac tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:14.454810 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de613481-d4cb-4e85-808f-b081cc5bfeac tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:14.455708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-12e3b1e7-4aae-4299-b67d-1b1dd589de9e req-0ef1aa62-1f69-426d-b676-28841ec9b1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558b2e47-a791-433b-902c-8b72a0a0e78f", "name": "network-vif-plugged", "status": "completed", "tag": "24bef117-21a5-4e33-9c7e-eae40346e83c"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:38:14.465351 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-12e3b1e7-4aae-4299-b67d-1b1dd589de9e req-0ef1aa62-1f69-426d-b676-28841ec9b1c0 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:14.465830 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-12e3b1e7-4aae-4299-b67d-1b1dd589de9e req-0ef1aa62-1f69-426d-b676-28841ec9b1c0 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:14.466256 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-12e3b1e7-4aae-4299-b67d-1b1dd589de9e req-0ef1aa62-1f69-426d-b676-28841ec9b1c0 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:14.478714 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-12e3b1e7-4aae-4299-b67d-1b1dd589de9e req-0ef1aa62-1f69-426d-b676-28841ec9b1c0 service nova] Creating event network-vif-plugged:24bef117-21a5-4e33-9c7e-eae40346e83c for instance 558b2e47-a791-433b-902c-8b72a0a0e78f on hv-cinder-85638 Sep 13 06:38:14.484060 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-12e3b1e7-4aae-4299-b67d-1b1dd589de9e req-0ef1aa62-1f69-426d-b676-28841ec9b1c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032687 Sep 13 06:38:14.485007 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 63/132] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:38:14.620906 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-de613481-d4cb-4e85-808f-b081cc5bfeac tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:14.629946 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-de613481-d4cb-4e85-808f-b081cc5bfeac tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.196741 Sep 13 06:38:14.630690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 70/133] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:14 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:14.953371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-36284f15-eaa3-4fa5-9f95-5fc62a2243c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:14.954304 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-36284f15-eaa3-4fa5-9f95-5fc62a2243c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:14.963712 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36284f15-eaa3-4fa5-9f95-5fc62a2243c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:14.964275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36284f15-eaa3-4fa5-9f95-5fc62a2243c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:14.964957 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36284f15-eaa3-4fa5-9f95-5fc62a2243c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:14.965867 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36284f15-eaa3-4fa5-9f95-5fc62a2243c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:14.966525 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36284f15-eaa3-4fa5-9f95-5fc62a2243c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:14.967181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-36284f15-eaa3-4fa5-9f95-5fc62a2243c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:15.117574 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-36284f15-eaa3-4fa5-9f95-5fc62a2243c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:15.125911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-36284f15-eaa3-4fa5-9f95-5fc62a2243c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.176708 Sep 13 06:38:15.126491 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 64/134] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:14 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:15.242925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-031becb0-9521-4fbd-ae46-ec87b94ad0bf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:15.243683 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-031becb0-9521-4fbd-ae46-ec87b94ad0bf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:15.250145 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-031becb0-9521-4fbd-ae46-ec87b94ad0bf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:15.250859 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-031becb0-9521-4fbd-ae46-ec87b94ad0bf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:15.251633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-031becb0-9521-4fbd-ae46-ec87b94ad0bf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:15.252759 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-031becb0-9521-4fbd-ae46-ec87b94ad0bf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:15.253407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-031becb0-9521-4fbd-ae46-ec87b94ad0bf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:15.254034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-031becb0-9521-4fbd-ae46-ec87b94ad0bf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:15.387917 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-787a1fba-266f-4ca6-ae48-2583113dc24d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:15.388679 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-787a1fba-266f-4ca6-ae48-2583113dc24d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:15.394413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-031becb0-9521-4fbd-ae46-ec87b94ad0bf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:15.403719 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-787a1fba-266f-4ca6-ae48-2583113dc24d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:15.404335 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-787a1fba-266f-4ca6-ae48-2583113dc24d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:15.405223 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-787a1fba-266f-4ca6-ae48-2583113dc24d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:15.405421 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-031becb0-9521-4fbd-ae46-ec87b94ad0bf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.166646 Sep 13 06:38:15.419942 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 71/135] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:15 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:15.420461 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-787a1fba-266f-4ca6-ae48-2583113dc24d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:15.421050 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-787a1fba-266f-4ca6-ae48-2583113dc24d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:15.421485 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-787a1fba-266f-4ca6-ae48-2583113dc24d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:15.566095 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-787a1fba-266f-4ca6-ae48-2583113dc24d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:15.573658 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-787a1fba-266f-4ca6-ae48-2583113dc24d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.190031 Sep 13 06:38:15.574856 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 65/136] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:15 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:15.653973 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9f020d6f-6a1a-4865-87f6-fdf18283d573 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:15.654562 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9f020d6f-6a1a-4865-87f6-fdf18283d573 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:15.660444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9f020d6f-6a1a-4865-87f6-fdf18283d573 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:15.660927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9f020d6f-6a1a-4865-87f6-fdf18283d573 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:15.661354 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9f020d6f-6a1a-4865-87f6-fdf18283d573 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:15.662255 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9f020d6f-6a1a-4865-87f6-fdf18283d573 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:15.662703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9f020d6f-6a1a-4865-87f6-fdf18283d573 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:15.663294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9f020d6f-6a1a-4865-87f6-fdf18283d573 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:15.847293 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9f020d6f-6a1a-4865-87f6-fdf18283d573 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:15.858014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9f020d6f-6a1a-4865-87f6-fdf18283d573 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.207652 Sep 13 06:38:15.859112 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 72/137] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:15 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:16.148826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-acd9769d-18ce-4be8-af23-49a838b7fc5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:16.149513 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-acd9769d-18ce-4be8-af23-49a838b7fc5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:16.156476 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd9769d-18ce-4be8-af23-49a838b7fc5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:16.156956 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd9769d-18ce-4be8-af23-49a838b7fc5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:16.157385 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd9769d-18ce-4be8-af23-49a838b7fc5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:16.158065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd9769d-18ce-4be8-af23-49a838b7fc5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:16.158513 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd9769d-18ce-4be8-af23-49a838b7fc5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:16.158924 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd9769d-18ce-4be8-af23-49a838b7fc5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:16.178255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:16.300863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-acd9769d-18ce-4be8-af23-49a838b7fc5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:16.308555 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-acd9769d-18ce-4be8-af23-49a838b7fc5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.163616 Sep 13 06:38:16.309120 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 66/138] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:16 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:16.434664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8d2885a6-477d-4521-9270-6bba361e9858 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:16.435260 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8d2885a6-477d-4521-9270-6bba361e9858 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:16.441246 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8d2885a6-477d-4521-9270-6bba361e9858 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:16.441799 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8d2885a6-477d-4521-9270-6bba361e9858 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:16.442227 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8d2885a6-477d-4521-9270-6bba361e9858 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:16.442899 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8d2885a6-477d-4521-9270-6bba361e9858 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:16.443438 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8d2885a6-477d-4521-9270-6bba361e9858 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:16.443977 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8d2885a6-477d-4521-9270-6bba361e9858 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:16.586516 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8d2885a6-477d-4521-9270-6bba361e9858 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:16.597566 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8d2885a6-477d-4521-9270-6bba361e9858 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.167846 Sep 13 06:38:16.598312 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 73/139] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:16 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:16.603599 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3a022186-8009-4fe7-8b69-d4ab1a484841 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:16.604783 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3a022186-8009-4fe7-8b69-d4ab1a484841 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:16.614767 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a022186-8009-4fe7-8b69-d4ab1a484841 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:16.615681 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a022186-8009-4fe7-8b69-d4ab1a484841 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:16.616486 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a022186-8009-4fe7-8b69-d4ab1a484841 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:16.617718 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a022186-8009-4fe7-8b69-d4ab1a484841 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:16.618577 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a022186-8009-4fe7-8b69-d4ab1a484841 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:16.619333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a022186-8009-4fe7-8b69-d4ab1a484841 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:16.777325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3a022186-8009-4fe7-8b69-d4ab1a484841 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:16.785060 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3a022186-8009-4fe7-8b69-d4ab1a484841 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.188839 Sep 13 06:38:16.785627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 67/140] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:16 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:16.885798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-18d18807-c3aa-4165-b1b7-7120fa5b8543 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:16.886405 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-18d18807-c3aa-4165-b1b7-7120fa5b8543 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:16.893136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18d18807-c3aa-4165-b1b7-7120fa5b8543 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:16.893625 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18d18807-c3aa-4165-b1b7-7120fa5b8543 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:16.894060 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18d18807-c3aa-4165-b1b7-7120fa5b8543 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:16.894762 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18d18807-c3aa-4165-b1b7-7120fa5b8543 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:16.895217 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18d18807-c3aa-4165-b1b7-7120fa5b8543 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:16.895668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18d18807-c3aa-4165-b1b7-7120fa5b8543 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:17.119799 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-18d18807-c3aa-4165-b1b7-7120fa5b8543 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:17.128873 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-18d18807-c3aa-4165-b1b7-7120fa5b8543 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.246808 Sep 13 06:38:17.129459 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 74/141] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:16 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:17.334912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-387c690d-32c4-4b4f-a2eb-f560b720d3bc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:17.346829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-387c690d-32c4-4b4f-a2eb-f560b720d3bc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:17.353809 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-387c690d-32c4-4b4f-a2eb-f560b720d3bc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:17.354579 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-387c690d-32c4-4b4f-a2eb-f560b720d3bc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:17.355302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-387c690d-32c4-4b4f-a2eb-f560b720d3bc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:17.356031 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-387c690d-32c4-4b4f-a2eb-f560b720d3bc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:17.356533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-387c690d-32c4-4b4f-a2eb-f560b720d3bc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:17.356953 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-387c690d-32c4-4b4f-a2eb-f560b720d3bc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:17.479705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-a0747f74-44ba-48b1-9ac2-8758a72bcc0c req-3b7e0ca0-184c-4a23-aa67-b7d60d023a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9fa6279-bb1f-4dca-b762-cde8a7310fb2", "name": "network-vif-plugged", "status": "completed", "tag": "a00bdd4f-e8d5-4657-812d-5a3531fc68eb"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:38:17.499384 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a0747f74-44ba-48b1-9ac2-8758a72bcc0c req-3b7e0ca0-184c-4a23-aa67-b7d60d023a90 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:17.499861 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a0747f74-44ba-48b1-9ac2-8758a72bcc0c req-3b7e0ca0-184c-4a23-aa67-b7d60d023a90 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:17.500288 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a0747f74-44ba-48b1-9ac2-8758a72bcc0c req-3b7e0ca0-184c-4a23-aa67-b7d60d023a90 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:17.535835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-a0747f74-44ba-48b1-9ac2-8758a72bcc0c req-3b7e0ca0-184c-4a23-aa67-b7d60d023a90 service nova] Creating event network-vif-plugged:a00bdd4f-e8d5-4657-812d-5a3531fc68eb for instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 on hv-cinder-85638 Sep 13 06:38:17.545717 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-a0747f74-44ba-48b1-9ac2-8758a72bcc0c req-3b7e0ca0-184c-4a23-aa67-b7d60d023a90 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069494 Sep 13 06:38:17.547341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 75/142] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:38:17.611945 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-387c690d-32c4-4b4f-a2eb-f560b720d3bc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:17.624376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-906c8781-3b8f-4175-a0bd-4afbe5f1415a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:17.625896 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-906c8781-3b8f-4175-a0bd-4afbe5f1415a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:17.640379 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-387c690d-32c4-4b4f-a2eb-f560b720d3bc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.306457 Sep 13 06:38:17.642467 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-906c8781-3b8f-4175-a0bd-4afbe5f1415a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:17.643754 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 68/143] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:17 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:17.644495 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-906c8781-3b8f-4175-a0bd-4afbe5f1415a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:17.645347 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-906c8781-3b8f-4175-a0bd-4afbe5f1415a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:17.646260 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-906c8781-3b8f-4175-a0bd-4afbe5f1415a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:17.646918 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-906c8781-3b8f-4175-a0bd-4afbe5f1415a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:17.649432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-906c8781-3b8f-4175-a0bd-4afbe5f1415a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:17.810274 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2a83a6f9-f5fd-4772-9d5c-c5ff2526eefa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:17.811162 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2a83a6f9-f5fd-4772-9d5c-c5ff2526eefa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:17.819231 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2a83a6f9-f5fd-4772-9d5c-c5ff2526eefa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:17.820511 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2a83a6f9-f5fd-4772-9d5c-c5ff2526eefa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:17.820904 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2a83a6f9-f5fd-4772-9d5c-c5ff2526eefa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:17.821598 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2a83a6f9-f5fd-4772-9d5c-c5ff2526eefa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:17.822218 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2a83a6f9-f5fd-4772-9d5c-c5ff2526eefa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:17.822873 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2a83a6f9-f5fd-4772-9d5c-c5ff2526eefa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:18.078038 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2a83a6f9-f5fd-4772-9d5c-c5ff2526eefa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:18.086953 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2a83a6f9-f5fd-4772-9d5c-c5ff2526eefa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.283066 Sep 13 06:38:18.092103 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 69/144] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:17 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:18.154486 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-62282640-7a28-4363-ac0d-1fb6b3570a8a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:18.155115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-62282640-7a28-4363-ac0d-1fb6b3570a8a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:18.167336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62282640-7a28-4363-ac0d-1fb6b3570a8a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:18.168070 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62282640-7a28-4363-ac0d-1fb6b3570a8a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:18.168972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62282640-7a28-4363-ac0d-1fb6b3570a8a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:18.171742 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62282640-7a28-4363-ac0d-1fb6b3570a8a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:18.173326 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62282640-7a28-4363-ac0d-1fb6b3570a8a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:18.174399 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-62282640-7a28-4363-ac0d-1fb6b3570a8a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:18.208417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-906c8781-3b8f-4175-a0bd-4afbe5f1415a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:18.216743 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-906c8781-3b8f-4175-a0bd-4afbe5f1415a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.598956 Sep 13 06:38:18.218067 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 76/145] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:17 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:18.368674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-62282640-7a28-4363-ac0d-1fb6b3570a8a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:18.377853 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-62282640-7a28-4363-ac0d-1fb6b3570a8a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.229330 Sep 13 06:38:18.378452 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 70/146] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:18 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:18.667333 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-dfed5286-9958-429c-aa53-3ef41939c8e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:18.667960 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-dfed5286-9958-429c-aa53-3ef41939c8e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:18.674419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dfed5286-9958-429c-aa53-3ef41939c8e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:18.674903 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dfed5286-9958-429c-aa53-3ef41939c8e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:18.675337 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dfed5286-9958-429c-aa53-3ef41939c8e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:18.676049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dfed5286-9958-429c-aa53-3ef41939c8e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:18.676504 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dfed5286-9958-429c-aa53-3ef41939c8e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:18.676925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dfed5286-9958-429c-aa53-3ef41939c8e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:18.802717 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dfed5286-9958-429c-aa53-3ef41939c8e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:18.810883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-dfed5286-9958-429c-aa53-3ef41939c8e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.147688 Sep 13 06:38:18.812041 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 77/147] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:18 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:19.116503 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1851cc89-4e93-41ad-a93c-0aff2e0802de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:19.117012 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1851cc89-4e93-41ad-a93c-0aff2e0802de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:19.122869 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1851cc89-4e93-41ad-a93c-0aff2e0802de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:19.123340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1851cc89-4e93-41ad-a93c-0aff2e0802de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:19.123798 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1851cc89-4e93-41ad-a93c-0aff2e0802de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:19.124472 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1851cc89-4e93-41ad-a93c-0aff2e0802de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:19.124917 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1851cc89-4e93-41ad-a93c-0aff2e0802de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:19.125332 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1851cc89-4e93-41ad-a93c-0aff2e0802de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:19.240890 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3a2c3d54-b484-4759-9922-39e989212413 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:19.241820 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3a2c3d54-b484-4759-9922-39e989212413 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:19.248551 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a2c3d54-b484-4759-9922-39e989212413 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:19.249355 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a2c3d54-b484-4759-9922-39e989212413 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:19.250020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a2c3d54-b484-4759-9922-39e989212413 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:19.250734 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a2c3d54-b484-4759-9922-39e989212413 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:19.251201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a2c3d54-b484-4759-9922-39e989212413 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:19.251670 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a2c3d54-b484-4759-9922-39e989212413 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:19.290729 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1851cc89-4e93-41ad-a93c-0aff2e0802de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:19.307829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1851cc89-4e93-41ad-a93c-0aff2e0802de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.195092 Sep 13 06:38:19.317854 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 71/148] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:19 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:19.401302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d8481c73-63bd-41dd-bc7e-00dc5e8c099b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:19.402708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d8481c73-63bd-41dd-bc7e-00dc5e8c099b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:19.409478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8481c73-63bd-41dd-bc7e-00dc5e8c099b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:19.410275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8481c73-63bd-41dd-bc7e-00dc5e8c099b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:19.410891 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8481c73-63bd-41dd-bc7e-00dc5e8c099b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:19.411879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8481c73-63bd-41dd-bc7e-00dc5e8c099b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:19.412537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8481c73-63bd-41dd-bc7e-00dc5e8c099b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:19.413056 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8481c73-63bd-41dd-bc7e-00dc5e8c099b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:19.442468 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3a2c3d54-b484-4759-9922-39e989212413 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:19.450384 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3a2c3d54-b484-4759-9922-39e989212413 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.213777 Sep 13 06:38:19.450960 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 78/149] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:19 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:19.576135 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d8481c73-63bd-41dd-bc7e-00dc5e8c099b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:19.596797 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d8481c73-63bd-41dd-bc7e-00dc5e8c099b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.199162 Sep 13 06:38:19.597736 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 72/150] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:19 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:19.834791 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3051ed77-e80c-41f7-881e-29b9986dfd21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:19.835907 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3051ed77-e80c-41f7-881e-29b9986dfd21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:19.847008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3051ed77-e80c-41f7-881e-29b9986dfd21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:19.847008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3051ed77-e80c-41f7-881e-29b9986dfd21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:19.847008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3051ed77-e80c-41f7-881e-29b9986dfd21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:19.847008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3051ed77-e80c-41f7-881e-29b9986dfd21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:19.847324 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3051ed77-e80c-41f7-881e-29b9986dfd21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:19.847324 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3051ed77-e80c-41f7-881e-29b9986dfd21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:19.992898 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3051ed77-e80c-41f7-881e-29b9986dfd21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:20.001291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3051ed77-e80c-41f7-881e-29b9986dfd21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.170860 Sep 13 06:38:20.002179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 79/151] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:19 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:20.331027 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5adfa2c6-7b70-43f8-9cce-4193d2df398f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:20.331680 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5adfa2c6-7b70-43f8-9cce-4193d2df398f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:20.337754 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5adfa2c6-7b70-43f8-9cce-4193d2df398f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:20.338233 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5adfa2c6-7b70-43f8-9cce-4193d2df398f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:20.338660 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5adfa2c6-7b70-43f8-9cce-4193d2df398f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:20.339551 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5adfa2c6-7b70-43f8-9cce-4193d2df398f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:20.340160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5adfa2c6-7b70-43f8-9cce-4193d2df398f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:20.340576 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5adfa2c6-7b70-43f8-9cce-4193d2df398f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:20.473748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5adfa2c6-7b70-43f8-9cce-4193d2df398f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:20.474334 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fa8f2fdf-50b8-4997-a74b-1ecad392b3a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:20.474900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fa8f2fdf-50b8-4997-a74b-1ecad392b3a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:20.482323 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fa8f2fdf-50b8-4997-a74b-1ecad392b3a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:20.482466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5adfa2c6-7b70-43f8-9cce-4193d2df398f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.155221 Sep 13 06:38:20.482913 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 73/152] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:20 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:20.483326 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fa8f2fdf-50b8-4997-a74b-1ecad392b3a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:20.484512 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fa8f2fdf-50b8-4997-a74b-1ecad392b3a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:20.485292 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fa8f2fdf-50b8-4997-a74b-1ecad392b3a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:20.485827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fa8f2fdf-50b8-4997-a74b-1ecad392b3a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:20.486347 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fa8f2fdf-50b8-4997-a74b-1ecad392b3a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:20.622252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bafa054d-faca-4f6f-80cf-7f59fb833bc0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:20.622966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-bafa054d-faca-4f6f-80cf-7f59fb833bc0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:20.629695 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fa8f2fdf-50b8-4997-a74b-1ecad392b3a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:20.638778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bafa054d-faca-4f6f-80cf-7f59fb833bc0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:20.639394 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fa8f2fdf-50b8-4997-a74b-1ecad392b3a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.168316 Sep 13 06:38:20.639570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bafa054d-faca-4f6f-80cf-7f59fb833bc0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:20.640380 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bafa054d-faca-4f6f-80cf-7f59fb833bc0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:20.641086 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bafa054d-faca-4f6f-80cf-7f59fb833bc0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:20.641191 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 80/153] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:20 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:20.641537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bafa054d-faca-4f6f-80cf-7f59fb833bc0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:20.642073 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bafa054d-faca-4f6f-80cf-7f59fb833bc0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:20.775160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-bafa054d-faca-4f6f-80cf-7f59fb833bc0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:20.783037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-bafa054d-faca-4f6f-80cf-7f59fb833bc0 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.164512 Sep 13 06:38:20.783642 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 74/154] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:20 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:21.024243 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-63f69fdf-6a98-44f1-b1b1-4344e5dd3cca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:21.024846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-63f69fdf-6a98-44f1-b1b1-4344e5dd3cca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:21.030547 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63f69fdf-6a98-44f1-b1b1-4344e5dd3cca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:21.031027 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63f69fdf-6a98-44f1-b1b1-4344e5dd3cca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:21.031482 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63f69fdf-6a98-44f1-b1b1-4344e5dd3cca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:21.032164 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63f69fdf-6a98-44f1-b1b1-4344e5dd3cca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:21.032609 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63f69fdf-6a98-44f1-b1b1-4344e5dd3cca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:21.033024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63f69fdf-6a98-44f1-b1b1-4344e5dd3cca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:21.176293 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-63f69fdf-6a98-44f1-b1b1-4344e5dd3cca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:21.188191 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-63f69fdf-6a98-44f1-b1b1-4344e5dd3cca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.167670 Sep 13 06:38:21.189101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 81/155] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:21 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:21.505795 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-43954ddc-cc45-434b-b229-664a4901c766 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:21.506402 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-43954ddc-cc45-434b-b229-664a4901c766 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:21.512872 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43954ddc-cc45-434b-b229-664a4901c766 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:21.513355 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43954ddc-cc45-434b-b229-664a4901c766 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:21.513782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43954ddc-cc45-434b-b229-664a4901c766 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:21.514474 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43954ddc-cc45-434b-b229-664a4901c766 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:21.514975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43954ddc-cc45-434b-b229-664a4901c766 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:21.515467 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43954ddc-cc45-434b-b229-664a4901c766 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:21.652347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-43954ddc-cc45-434b-b229-664a4901c766 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:21.661960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-43954ddc-cc45-434b-b229-664a4901c766 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.160017 Sep 13 06:38:21.663326 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-01f15bad-c5f2-4d9e-8644-82241edd6932 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:21.664035 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-01f15bad-c5f2-4d9e-8644-82241edd6932 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:21.670750 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01f15bad-c5f2-4d9e-8644-82241edd6932 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:21.671311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01f15bad-c5f2-4d9e-8644-82241edd6932 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:21.671848 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01f15bad-c5f2-4d9e-8644-82241edd6932 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:21.672616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01f15bad-c5f2-4d9e-8644-82241edd6932 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:21.673104 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01f15bad-c5f2-4d9e-8644-82241edd6932 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:21.673525 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01f15bad-c5f2-4d9e-8644-82241edd6932 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:21.677146 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 75/156] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:21 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:21.807046 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f07b6441-10f7-4062-8ea6-227aa2d11c09 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:21.807787 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-01f15bad-c5f2-4d9e-8644-82241edd6932 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:21.808026 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f07b6441-10f7-4062-8ea6-227aa2d11c09 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:21.815266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f07b6441-10f7-4062-8ea6-227aa2d11c09 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:21.815785 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f07b6441-10f7-4062-8ea6-227aa2d11c09 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:21.815893 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-01f15bad-c5f2-4d9e-8644-82241edd6932 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.156468 Sep 13 06:38:21.816323 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f07b6441-10f7-4062-8ea6-227aa2d11c09 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:21.817027 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f07b6441-10f7-4062-8ea6-227aa2d11c09 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:21.817485 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f07b6441-10f7-4062-8ea6-227aa2d11c09 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:21.817912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f07b6441-10f7-4062-8ea6-227aa2d11c09 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:21.828876 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 82/157] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:21 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:21.949405 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f07b6441-10f7-4062-8ea6-227aa2d11c09 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:21.957773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f07b6441-10f7-4062-8ea6-227aa2d11c09 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.155315 Sep 13 06:38:21.958508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 76/158] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:21 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:22.211755 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9ed1c06b-b245-4663-ab92-c581defa4bcb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:22.212387 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9ed1c06b-b245-4663-ab92-c581defa4bcb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:22.218694 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ed1c06b-b245-4663-ab92-c581defa4bcb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:22.219179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ed1c06b-b245-4663-ab92-c581defa4bcb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:22.219634 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ed1c06b-b245-4663-ab92-c581defa4bcb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:22.220326 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ed1c06b-b245-4663-ab92-c581defa4bcb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:22.220782 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ed1c06b-b245-4663-ab92-c581defa4bcb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:22.221205 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9ed1c06b-b245-4663-ab92-c581defa4bcb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:22.227042 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:22.358948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9ed1c06b-b245-4663-ab92-c581defa4bcb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:22.367031 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9ed1c06b-b245-4663-ab92-c581defa4bcb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.158595 Sep 13 06:38:22.367150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 83/159] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:22 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:22.686894 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-753c7dee-5961-46d2-a154-179fa11a917f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:22.687535 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-753c7dee-5961-46d2-a154-179fa11a917f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:22.693629 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-753c7dee-5961-46d2-a154-179fa11a917f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:22.694116 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-753c7dee-5961-46d2-a154-179fa11a917f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:22.694548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-753c7dee-5961-46d2-a154-179fa11a917f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:22.695233 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-753c7dee-5961-46d2-a154-179fa11a917f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:22.695710 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-753c7dee-5961-46d2-a154-179fa11a917f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:22.696132 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-753c7dee-5961-46d2-a154-179fa11a917f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:22.839453 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5ae667dc-2c99-455c-a12a-13ce2d2b3273 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:22.840194 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5ae667dc-2c99-455c-a12a-13ce2d2b3273 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:22.841363 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-753c7dee-5961-46d2-a154-179fa11a917f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:22.846493 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ae667dc-2c99-455c-a12a-13ce2d2b3273 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:22.847061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ae667dc-2c99-455c-a12a-13ce2d2b3273 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:22.847602 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ae667dc-2c99-455c-a12a-13ce2d2b3273 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:22.848510 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ae667dc-2c99-455c-a12a-13ce2d2b3273 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:22.848967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ae667dc-2c99-455c-a12a-13ce2d2b3273 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:22.849509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ae667dc-2c99-455c-a12a-13ce2d2b3273 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:22.849903 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-753c7dee-5961-46d2-a154-179fa11a917f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.167328 Sep 13 06:38:22.851495 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 77/160] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:22 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:22.981330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e13235e8-ba25-4607-b4d2-176dfb31fbcc tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:22.981938 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e13235e8-ba25-4607-b4d2-176dfb31fbcc tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:22.982328 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5ae667dc-2c99-455c-a12a-13ce2d2b3273 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:22.989021 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e13235e8-ba25-4607-b4d2-176dfb31fbcc tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:22.989902 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e13235e8-ba25-4607-b4d2-176dfb31fbcc tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:22.990725 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e13235e8-ba25-4607-b4d2-176dfb31fbcc tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:22.991751 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e13235e8-ba25-4607-b4d2-176dfb31fbcc tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:22.991973 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5ae667dc-2c99-455c-a12a-13ce2d2b3273 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.156935 Sep 13 06:38:22.992211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e13235e8-ba25-4607-b4d2-176dfb31fbcc tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:22.995396 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e13235e8-ba25-4607-b4d2-176dfb31fbcc tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:22.995521 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 84/161] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:22 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:23.126245 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e13235e8-ba25-4607-b4d2-176dfb31fbcc tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:23.134014 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e13235e8-ba25-4607-b4d2-176dfb31fbcc tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.156443 Sep 13 06:38:23.134592 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 78/162] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:22 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:23.388100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c5f55c9e-4dcd-4517-8fe8-114970b54dbf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:23.388703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c5f55c9e-4dcd-4517-8fe8-114970b54dbf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:23.395550 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5f55c9e-4dcd-4517-8fe8-114970b54dbf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:23.396121 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5f55c9e-4dcd-4517-8fe8-114970b54dbf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:23.396620 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5f55c9e-4dcd-4517-8fe8-114970b54dbf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:23.397404 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5f55c9e-4dcd-4517-8fe8-114970b54dbf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:23.397928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5f55c9e-4dcd-4517-8fe8-114970b54dbf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:23.398423 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5f55c9e-4dcd-4517-8fe8-114970b54dbf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:23.544321 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c5f55c9e-4dcd-4517-8fe8-114970b54dbf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:23.552622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c5f55c9e-4dcd-4517-8fe8-114970b54dbf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.168352 Sep 13 06:38:23.554836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 85/163] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:23 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:23.873853 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-266b8f23-11e3-40a4-9bd4-ab0404e10932 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:23.874502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-266b8f23-11e3-40a4-9bd4-ab0404e10932 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:23.876380 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=97 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:23.882137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-266b8f23-11e3-40a4-9bd4-ab0404e10932 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:23.882730 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-266b8f23-11e3-40a4-9bd4-ab0404e10932 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:23.883108 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-266b8f23-11e3-40a4-9bd4-ab0404e10932 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:23.883811 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-266b8f23-11e3-40a4-9bd4-ab0404e10932 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:23.884254 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-266b8f23-11e3-40a4-9bd4-ab0404e10932 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:23.884645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-266b8f23-11e3-40a4-9bd4-ab0404e10932 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:24.016958 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d71bd34f-0c14-4d94-a375-610622b14d87 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:24.017690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d71bd34f-0c14-4d94-a375-610622b14d87 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:24.026105 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d71bd34f-0c14-4d94-a375-610622b14d87 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:24.026570 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d71bd34f-0c14-4d94-a375-610622b14d87 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:24.027303 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d71bd34f-0c14-4d94-a375-610622b14d87 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:24.028508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d71bd34f-0c14-4d94-a375-610622b14d87 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:24.029381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d71bd34f-0c14-4d94-a375-610622b14d87 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:24.030776 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d71bd34f-0c14-4d94-a375-610622b14d87 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:24.046759 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-266b8f23-11e3-40a4-9bd4-ab0404e10932 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:24.056771 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-266b8f23-11e3-40a4-9bd4-ab0404e10932 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.186809 Sep 13 06:38:24.073162 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 79/164] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:23 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:24.159829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2e3a2ebe-fe36-4fa7-9994-0ebcdb9bcc2d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:24.160495 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2e3a2ebe-fe36-4fa7-9994-0ebcdb9bcc2d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:24.167041 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e3a2ebe-fe36-4fa7-9994-0ebcdb9bcc2d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:24.167744 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e3a2ebe-fe36-4fa7-9994-0ebcdb9bcc2d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:24.168331 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e3a2ebe-fe36-4fa7-9994-0ebcdb9bcc2d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:24.169196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e3a2ebe-fe36-4fa7-9994-0ebcdb9bcc2d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:24.169792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e3a2ebe-fe36-4fa7-9994-0ebcdb9bcc2d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:24.170355 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e3a2ebe-fe36-4fa7-9994-0ebcdb9bcc2d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:24.185796 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-d71bd34f-0c14-4d94-a375-610622b14d87 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:24.193870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d71bd34f-0c14-4d94-a375-610622b14d87 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1362 microversion: 2.1 time: 0.182696 Sep 13 06:38:24.194441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 86/165] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:24 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:24.246572 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-0e88d99e-3d40-4492-801a-0f134de6a91c req-4cc1bdb1-6398-45eb-b067-7c70045cc8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af9e76b-6689-431b-a4c2-2d681d4098ba", "name": "network-vif-plugged", "status": "completed", "tag": "3c3acc09-6c0d-4f36-8f12-849b52e0123f"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:38:24.260544 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-0e88d99e-3d40-4492-801a-0f134de6a91c req-4cc1bdb1-6398-45eb-b067-7c70045cc8dd service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:24.261113 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-0e88d99e-3d40-4492-801a-0f134de6a91c req-4cc1bdb1-6398-45eb-b067-7c70045cc8dd service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:24.261628 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-0e88d99e-3d40-4492-801a-0f134de6a91c req-4cc1bdb1-6398-45eb-b067-7c70045cc8dd service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:24.274028 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-0e88d99e-3d40-4492-801a-0f134de6a91c req-4cc1bdb1-6398-45eb-b067-7c70045cc8dd service nova] Creating event network-vif-plugged:3c3acc09-6c0d-4f36-8f12-849b52e0123f for instance 1af9e76b-6689-431b-a4c2-2d681d4098ba on hv-cinder-85638 Sep 13 06:38:24.280234 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-0e88d99e-3d40-4492-801a-0f134de6a91c req-4cc1bdb1-6398-45eb-b067-7c70045cc8dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037803 Sep 13 06:38:24.281177 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 87/166] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:38:24.316415 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2e3a2ebe-fe36-4fa7-9994-0ebcdb9bcc2d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:24.325769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2e3a2ebe-fe36-4fa7-9994-0ebcdb9bcc2d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.171524 Sep 13 06:38:24.326336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 80/167] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:24 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:24.575800 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-26cb7af6-e0af-46fa-b09a-9adebe7b571a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:24.576503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-26cb7af6-e0af-46fa-b09a-9adebe7b571a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:24.582898 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26cb7af6-e0af-46fa-b09a-9adebe7b571a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:24.583394 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26cb7af6-e0af-46fa-b09a-9adebe7b571a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:24.583823 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26cb7af6-e0af-46fa-b09a-9adebe7b571a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:24.584621 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26cb7af6-e0af-46fa-b09a-9adebe7b571a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:24.585080 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26cb7af6-e0af-46fa-b09a-9adebe7b571a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:24.585494 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26cb7af6-e0af-46fa-b09a-9adebe7b571a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:24.728894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-26cb7af6-e0af-46fa-b09a-9adebe7b571a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:24.737103 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-26cb7af6-e0af-46fa-b09a-9adebe7b571a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.165528 Sep 13 06:38:24.737774 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 88/168] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:24 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:25.080885 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5a7ef8b6-7686-4ae4-a08e-7ee43ad5d56b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:25.081489 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5a7ef8b6-7686-4ae4-a08e-7ee43ad5d56b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:25.087724 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7ef8b6-7686-4ae4-a08e-7ee43ad5d56b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:25.088449 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7ef8b6-7686-4ae4-a08e-7ee43ad5d56b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:25.089178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7ef8b6-7686-4ae4-a08e-7ee43ad5d56b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:25.090104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7ef8b6-7686-4ae4-a08e-7ee43ad5d56b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:25.090761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7ef8b6-7686-4ae4-a08e-7ee43ad5d56b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:25.091942 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7ef8b6-7686-4ae4-a08e-7ee43ad5d56b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:25.216767 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-bd52eb12-6553-4bd4-b151-07fd876225cf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:25.217504 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-bd52eb12-6553-4bd4-b151-07fd876225cf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:25.226144 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bd52eb12-6553-4bd4-b151-07fd876225cf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:25.226855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bd52eb12-6553-4bd4-b151-07fd876225cf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:25.227431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bd52eb12-6553-4bd4-b151-07fd876225cf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:25.228269 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bd52eb12-6553-4bd4-b151-07fd876225cf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:25.228970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bd52eb12-6553-4bd4-b151-07fd876225cf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:25.230002 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bd52eb12-6553-4bd4-b151-07fd876225cf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:25.273912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5a7ef8b6-7686-4ae4-a08e-7ee43ad5d56b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:25.282949 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5a7ef8b6-7686-4ae4-a08e-7ee43ad5d56b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.206502 Sep 13 06:38:25.283530 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 81/169] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:25 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:25.348408 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d407f552-9707-48b8-8764-85852ff81d25 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:25.349316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d407f552-9707-48b8-8764-85852ff81d25 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:25.355602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d407f552-9707-48b8-8764-85852ff81d25 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:25.356010 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d407f552-9707-48b8-8764-85852ff81d25 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:25.356608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d407f552-9707-48b8-8764-85852ff81d25 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:25.359572 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d407f552-9707-48b8-8764-85852ff81d25 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:25.360202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d407f552-9707-48b8-8764-85852ff81d25 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:25.360674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d407f552-9707-48b8-8764-85852ff81d25 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:25.378673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-bd52eb12-6553-4bd4-b151-07fd876225cf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:25.387741 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-bd52eb12-6553-4bd4-b151-07fd876225cf tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1548 microversion: 2.1 time: 0.174773 Sep 13 06:38:25.388429 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 89/170] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:25 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1548 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:25.411547 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b5465593-ecd2-4f35-a758-c05f64e34591 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:25.412249 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b5465593-ecd2-4f35-a758-c05f64e34591 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:25.419195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5465593-ecd2-4f35-a758-c05f64e34591 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:25.419741 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5465593-ecd2-4f35-a758-c05f64e34591 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:25.420175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5465593-ecd2-4f35-a758-c05f64e34591 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:25.421399 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5465593-ecd2-4f35-a758-c05f64e34591 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:25.421879 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5465593-ecd2-4f35-a758-c05f64e34591 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:25.422322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5465593-ecd2-4f35-a758-c05f64e34591 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:25.520935 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d407f552-9707-48b8-8764-85852ff81d25 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:25.528820 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d407f552-9707-48b8-8764-85852ff81d25 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.184421 Sep 13 06:38:25.529391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 82/171] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:25 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:25.577874 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b5465593-ecd2-4f35-a758-c05f64e34591 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170756 Sep 13 06:38:25.578595 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 90/172] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Sep 13 06:38:25 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:38:25.759904 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a1b1a01f-5fea-4d2f-a560-25a9e71ecedd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:25.761029 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a1b1a01f-5fea-4d2f-a560-25a9e71ecedd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:25.767477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a1b1a01f-5fea-4d2f-a560-25a9e71ecedd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:25.768790 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a1b1a01f-5fea-4d2f-a560-25a9e71ecedd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:25.769407 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a1b1a01f-5fea-4d2f-a560-25a9e71ecedd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:25.770725 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a1b1a01f-5fea-4d2f-a560-25a9e71ecedd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:25.771339 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a1b1a01f-5fea-4d2f-a560-25a9e71ecedd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:25.771781 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a1b1a01f-5fea-4d2f-a560-25a9e71ecedd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:25.776030 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:26.107517 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a1b1a01f-5fea-4d2f-a560-25a9e71ecedd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:26.116864 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a1b1a01f-5fea-4d2f-a560-25a9e71ecedd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.360866 Sep 13 06:38:26.117951 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 83/173] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:25 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:26.307519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e4fb8d59-f266-4e55-a674-4eea0c201662 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:26.309151 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e4fb8d59-f266-4e55-a674-4eea0c201662 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:26.316537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d59-f266-4e55-a674-4eea0c201662 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:26.317231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d59-f266-4e55-a674-4eea0c201662 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:26.318045 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d59-f266-4e55-a674-4eea0c201662 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:26.319057 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d59-f266-4e55-a674-4eea0c201662 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:26.319694 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d59-f266-4e55-a674-4eea0c201662 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:26.320290 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d59-f266-4e55-a674-4eea0c201662 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:26.539032 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e4fb8d59-f266-4e55-a674-4eea0c201662 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:26.552571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-54d1aed1-e5b0-439b-aee3-b898c57e79ba tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:26.553230 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-54d1aed1-e5b0-439b-aee3-b898c57e79ba tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:26.563798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e4fb8d59-f266-4e55-a674-4eea0c201662 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.261031 Sep 13 06:38:26.564497 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54d1aed1-e5b0-439b-aee3-b898c57e79ba tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:26.565171 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54d1aed1-e5b0-439b-aee3-b898c57e79ba tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:26.565764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54d1aed1-e5b0-439b-aee3-b898c57e79ba tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:26.566469 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54d1aed1-e5b0-439b-aee3-b898c57e79ba tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:26.567032 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 91/174] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:26 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:26.567582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54d1aed1-e5b0-439b-aee3-b898c57e79ba tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:26.568143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-54d1aed1-e5b0-439b-aee3-b898c57e79ba tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:26.887965 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-54d1aed1-e5b0-439b-aee3-b898c57e79ba tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:26.901833 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-54d1aed1-e5b0-439b-aee3-b898c57e79ba tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.353194 Sep 13 06:38:26.902716 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 84/175] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:26 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:27.144381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-923f466c-206e-4233-a6fe-20abac20d6fb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:27.144993 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-923f466c-206e-4233-a6fe-20abac20d6fb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:27.156317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-923f466c-206e-4233-a6fe-20abac20d6fb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:27.157083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-923f466c-206e-4233-a6fe-20abac20d6fb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:27.158168 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-923f466c-206e-4233-a6fe-20abac20d6fb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:27.160169 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-923f466c-206e-4233-a6fe-20abac20d6fb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:27.160957 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-923f466c-206e-4233-a6fe-20abac20d6fb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:27.161533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-923f466c-206e-4233-a6fe-20abac20d6fb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:27.253205 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-006f1fb1-531f-4512-a778-de406bdebd22 req-ab2ff22c-fd21-4d4f-be30-b0304bf24ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e145800-524d-4430-b95f-aff5b2719b66", "tag": "f7108ccd-a719-43b7-9171-8b580de3d99d"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:38:27.267497 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-006f1fb1-531f-4512-a778-de406bdebd22 req-ab2ff22c-fd21-4d4f-be30-b0304bf24ca0 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:27.269714 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-006f1fb1-531f-4512-a778-de406bdebd22 req-ab2ff22c-fd21-4d4f-be30-b0304bf24ca0 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:27.270161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-006f1fb1-531f-4512-a778-de406bdebd22 req-ab2ff22c-fd21-4d4f-be30-b0304bf24ca0 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:27.298347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-006f1fb1-531f-4512-a778-de406bdebd22 req-ab2ff22c-fd21-4d4f-be30-b0304bf24ca0 service nova] Creating event network-changed:f7108ccd-a719-43b7-9171-8b580de3d99d for instance 4e145800-524d-4430-b95f-aff5b2719b66 on hv-cinder-85638 Sep 13 06:38:27.305234 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-006f1fb1-531f-4512-a778-de406bdebd22 req-ab2ff22c-fd21-4d4f-be30-b0304bf24ca0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055836 Sep 13 06:38:27.316297 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 85/176] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:38:27.410548 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-923f466c-206e-4233-a6fe-20abac20d6fb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:27.431724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-923f466c-206e-4233-a6fe-20abac20d6fb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.284469 Sep 13 06:38:27.431724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 92/177] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:27 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:27.594133 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-683d24ff-9122-43d0-86b4-b65b1f0ba26d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:27.595063 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-683d24ff-9122-43d0-86b4-b65b1f0ba26d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:27.606431 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-683d24ff-9122-43d0-86b4-b65b1f0ba26d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:27.607094 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-683d24ff-9122-43d0-86b4-b65b1f0ba26d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:27.608813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-683d24ff-9122-43d0-86b4-b65b1f0ba26d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:27.610732 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-683d24ff-9122-43d0-86b4-b65b1f0ba26d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:27.611381 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-683d24ff-9122-43d0-86b4-b65b1f0ba26d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:27.612141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-683d24ff-9122-43d0-86b4-b65b1f0ba26d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:27.773897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-683d24ff-9122-43d0-86b4-b65b1f0ba26d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:27.783039 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-683d24ff-9122-43d0-86b4-b65b1f0ba26d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.196343 Sep 13 06:38:27.784225 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 86/178] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:27 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:27.926744 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ddef0060-3168-448d-95d2-821b66747fd5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:27.927294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ddef0060-3168-448d-95d2-821b66747fd5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:27.934759 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddef0060-3168-448d-95d2-821b66747fd5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:27.935959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddef0060-3168-448d-95d2-821b66747fd5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:27.937380 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddef0060-3168-448d-95d2-821b66747fd5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:27.938576 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddef0060-3168-448d-95d2-821b66747fd5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:27.939697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddef0060-3168-448d-95d2-821b66747fd5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:27.940479 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddef0060-3168-448d-95d2-821b66747fd5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:28.127725 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ddef0060-3168-448d-95d2-821b66747fd5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:28.137027 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ddef0060-3168-448d-95d2-821b66747fd5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.214244 Sep 13 06:38:28.138240 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 93/179] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:27 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:28.446085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c84275c1-0281-4e79-a20b-989319eb6208 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:28.450090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c84275c1-0281-4e79-a20b-989319eb6208 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:28.464749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c84275c1-0281-4e79-a20b-989319eb6208 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:28.465252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c84275c1-0281-4e79-a20b-989319eb6208 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:28.466610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c84275c1-0281-4e79-a20b-989319eb6208 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:28.466610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c84275c1-0281-4e79-a20b-989319eb6208 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:28.466915 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c84275c1-0281-4e79-a20b-989319eb6208 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:28.467504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c84275c1-0281-4e79-a20b-989319eb6208 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:28.682676 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c84275c1-0281-4e79-a20b-989319eb6208 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:28.694218 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c84275c1-0281-4e79-a20b-989319eb6208 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.252884 Sep 13 06:38:28.694708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 87/180] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:28 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:28.807663 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-20c977f7-edb5-4dc0-b8b1-5ad833bae9fe tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:28.808922 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-20c977f7-edb5-4dc0-b8b1-5ad833bae9fe tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:28.815795 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20c977f7-edb5-4dc0-b8b1-5ad833bae9fe tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:28.816451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20c977f7-edb5-4dc0-b8b1-5ad833bae9fe tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:28.816858 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20c977f7-edb5-4dc0-b8b1-5ad833bae9fe tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:28.817543 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20c977f7-edb5-4dc0-b8b1-5ad833bae9fe tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:28.818187 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20c977f7-edb5-4dc0-b8b1-5ad833bae9fe tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:28.818785 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20c977f7-edb5-4dc0-b8b1-5ad833bae9fe tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:28.971026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-20c977f7-edb5-4dc0-b8b1-5ad833bae9fe tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:28.979385 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-20c977f7-edb5-4dc0-b8b1-5ad833bae9fe tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.175703 Sep 13 06:38:28.980427 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 94/181] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:28 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:29.161274 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-85301582-2d0b-4f6c-8fff-9445ec7485a1 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:29.161885 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-85301582-2d0b-4f6c-8fff-9445ec7485a1 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:29.167852 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85301582-2d0b-4f6c-8fff-9445ec7485a1 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:29.168515 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85301582-2d0b-4f6c-8fff-9445ec7485a1 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:29.169111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85301582-2d0b-4f6c-8fff-9445ec7485a1 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:29.174374 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85301582-2d0b-4f6c-8fff-9445ec7485a1 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:29.174900 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85301582-2d0b-4f6c-8fff-9445ec7485a1 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:29.175307 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85301582-2d0b-4f6c-8fff-9445ec7485a1 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:29.331509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-85301582-2d0b-4f6c-8fff-9445ec7485a1 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:29.339722 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-85301582-2d0b-4f6c-8fff-9445ec7485a1 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1315 microversion: 2.1 time: 0.182056 Sep 13 06:38:29.340469 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 88/182] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:29 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:29.717394 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f689a905-8e4d-4d30-bbb7-a3ac4b5e1402 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:29.718360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f689a905-8e4d-4d30-bbb7-a3ac4b5e1402 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:29.724489 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f689a905-8e4d-4d30-bbb7-a3ac4b5e1402 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:29.725478 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f689a905-8e4d-4d30-bbb7-a3ac4b5e1402 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:29.726099 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f689a905-8e4d-4d30-bbb7-a3ac4b5e1402 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:29.726994 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f689a905-8e4d-4d30-bbb7-a3ac4b5e1402 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:29.727700 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f689a905-8e4d-4d30-bbb7-a3ac4b5e1402 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:29.728307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f689a905-8e4d-4d30-bbb7-a3ac4b5e1402 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:29.892858 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f689a905-8e4d-4d30-bbb7-a3ac4b5e1402 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:29.901418 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f689a905-8e4d-4d30-bbb7-a3ac4b5e1402 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.187899 Sep 13 06:38:29.902160 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 95/183] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:29 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:30.005834 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9f55ded4-0ad2-4aaa-b4af-e56fa9fba27a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:30.006432 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9f55ded4-0ad2-4aaa-b4af-e56fa9fba27a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:30.012836 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9f55ded4-0ad2-4aaa-b4af-e56fa9fba27a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:30.013521 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9f55ded4-0ad2-4aaa-b4af-e56fa9fba27a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:30.014104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9f55ded4-0ad2-4aaa-b4af-e56fa9fba27a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:30.014976 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9f55ded4-0ad2-4aaa-b4af-e56fa9fba27a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:30.015678 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9f55ded4-0ad2-4aaa-b4af-e56fa9fba27a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:30.016167 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9f55ded4-0ad2-4aaa-b4af-e56fa9fba27a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:30.192116 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9f55ded4-0ad2-4aaa-b4af-e56fa9fba27a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:30.199832 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9f55ded4-0ad2-4aaa-b4af-e56fa9fba27a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.197882 Sep 13 06:38:30.201052 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 89/184] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:30 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:30.365173 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e337d130-105e-49a5-a148-b9dfe42862b5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:30.365776 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e337d130-105e-49a5-a148-b9dfe42862b5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:30.367788 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=98 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:30.373297 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e337d130-105e-49a5-a148-b9dfe42862b5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:30.374303 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e337d130-105e-49a5-a148-b9dfe42862b5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:30.374733 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e337d130-105e-49a5-a148-b9dfe42862b5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:30.375441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e337d130-105e-49a5-a148-b9dfe42862b5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:30.375892 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e337d130-105e-49a5-a148-b9dfe42862b5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:30.376309 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e337d130-105e-49a5-a148-b9dfe42862b5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:30.531896 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e337d130-105e-49a5-a148-b9dfe42862b5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:30.541294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e337d130-105e-49a5-a148-b9dfe42862b5 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1502 microversion: 2.1 time: 0.180368 Sep 13 06:38:30.542669 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 96/185] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:30 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:30.927272 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9cf1e31f-bb3e-45ea-9cbb-7c096542a712 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:30.928128 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9cf1e31f-bb3e-45ea-9cbb-7c096542a712 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:30.938066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9cf1e31f-bb3e-45ea-9cbb-7c096542a712 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:30.939855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9cf1e31f-bb3e-45ea-9cbb-7c096542a712 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:30.940479 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9cf1e31f-bb3e-45ea-9cbb-7c096542a712 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:30.941561 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9cf1e31f-bb3e-45ea-9cbb-7c096542a712 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:30.945830 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9cf1e31f-bb3e-45ea-9cbb-7c096542a712 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:30.946476 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9cf1e31f-bb3e-45ea-9cbb-7c096542a712 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:31.110309 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9cf1e31f-bb3e-45ea-9cbb-7c096542a712 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:31.118305 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9cf1e31f-bb3e-45ea-9cbb-7c096542a712 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.194967 Sep 13 06:38:31.119088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 90/186] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:30 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:31.225563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1164f9b4-7811-40d8-adf1-4ab5efeec12a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:31.233150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1164f9b4-7811-40d8-adf1-4ab5efeec12a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:31.245075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1164f9b4-7811-40d8-adf1-4ab5efeec12a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:31.245969 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1164f9b4-7811-40d8-adf1-4ab5efeec12a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:31.249495 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1164f9b4-7811-40d8-adf1-4ab5efeec12a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:31.249495 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1164f9b4-7811-40d8-adf1-4ab5efeec12a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:31.249768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1164f9b4-7811-40d8-adf1-4ab5efeec12a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:31.250137 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1164f9b4-7811-40d8-adf1-4ab5efeec12a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:31.545130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1164f9b4-7811-40d8-adf1-4ab5efeec12a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:31.558182 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1164f9b4-7811-40d8-adf1-4ab5efeec12a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.336704 Sep 13 06:38:31.559075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 97/187] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:31 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:32.142783 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-345e8c81-97bf-431c-bf30-e8cf963fe830 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:32.143609 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-345e8c81-97bf-431c-bf30-e8cf963fe830 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:32.149606 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-345e8c81-97bf-431c-bf30-e8cf963fe830 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:32.150159 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-345e8c81-97bf-431c-bf30-e8cf963fe830 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:32.150738 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-345e8c81-97bf-431c-bf30-e8cf963fe830 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:32.151528 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-345e8c81-97bf-431c-bf30-e8cf963fe830 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:32.152049 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-345e8c81-97bf-431c-bf30-e8cf963fe830 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:32.153005 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-345e8c81-97bf-431c-bf30-e8cf963fe830 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:32.309033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-345e8c81-97bf-431c-bf30-e8cf963fe830 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:32.316680 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-345e8c81-97bf-431c-bf30-e8cf963fe830 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.178777 Sep 13 06:38:32.327204 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 91/188] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:32 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:32.586436 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f042d60d-7fe8-408a-88b0-fe0c44e34176 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:32.587409 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f042d60d-7fe8-408a-88b0-fe0c44e34176 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:32.593605 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f042d60d-7fe8-408a-88b0-fe0c44e34176 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:32.594382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f042d60d-7fe8-408a-88b0-fe0c44e34176 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:32.594813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f042d60d-7fe8-408a-88b0-fe0c44e34176 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:32.595745 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f042d60d-7fe8-408a-88b0-fe0c44e34176 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:32.596201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f042d60d-7fe8-408a-88b0-fe0c44e34176 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:32.596627 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f042d60d-7fe8-408a-88b0-fe0c44e34176 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:32.735109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f042d60d-7fe8-408a-88b0-fe0c44e34176 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:32.743047 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f042d60d-7fe8-408a-88b0-fe0c44e34176 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.161782 Sep 13 06:38:32.743638 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 98/189] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:32 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:33.340191 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f963d4f0-f8fa-469c-a733-ffa1683e9fe2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:33.340802 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f963d4f0-f8fa-469c-a733-ffa1683e9fe2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:33.346969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f963d4f0-f8fa-469c-a733-ffa1683e9fe2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:33.347484 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f963d4f0-f8fa-469c-a733-ffa1683e9fe2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:33.347922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f963d4f0-f8fa-469c-a733-ffa1683e9fe2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:33.348614 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f963d4f0-f8fa-469c-a733-ffa1683e9fe2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:33.349068 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f963d4f0-f8fa-469c-a733-ffa1683e9fe2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:33.349492 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f963d4f0-f8fa-469c-a733-ffa1683e9fe2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:33.485723 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f963d4f0-f8fa-469c-a733-ffa1683e9fe2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:33.493909 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f963d4f0-f8fa-469c-a733-ffa1683e9fe2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.157866 Sep 13 06:38:33.494560 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 92/190] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:33 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:33.766722 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-76d19162-6126-406b-952e-e31067889e8a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:33.767544 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-76d19162-6126-406b-952e-e31067889e8a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:33.773721 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-76d19162-6126-406b-952e-e31067889e8a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:33.774199 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-76d19162-6126-406b-952e-e31067889e8a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:33.774677 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-76d19162-6126-406b-952e-e31067889e8a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:33.775389 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-76d19162-6126-406b-952e-e31067889e8a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:33.776055 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-76d19162-6126-406b-952e-e31067889e8a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:33.776476 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-76d19162-6126-406b-952e-e31067889e8a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:33.912139 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-76d19162-6126-406b-952e-e31067889e8a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:33.920128 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-76d19162-6126-406b-952e-e31067889e8a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.157677 Sep 13 06:38:33.921334 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 99/191] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:33 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:34.519848 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-47b13aaf-9850-4b0f-b5b9-015ca010a636 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:34.520453 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-47b13aaf-9850-4b0f-b5b9-015ca010a636 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:34.526280 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-47b13aaf-9850-4b0f-b5b9-015ca010a636 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:34.526758 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-47b13aaf-9850-4b0f-b5b9-015ca010a636 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:34.527189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-47b13aaf-9850-4b0f-b5b9-015ca010a636 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:34.527892 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-47b13aaf-9850-4b0f-b5b9-015ca010a636 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:34.528343 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-47b13aaf-9850-4b0f-b5b9-015ca010a636 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:34.528762 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-47b13aaf-9850-4b0f-b5b9-015ca010a636 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:34.657544 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-47b13aaf-9850-4b0f-b5b9-015ca010a636 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:34.665273 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-47b13aaf-9850-4b0f-b5b9-015ca010a636 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.148945 Sep 13 06:38:34.665836 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 93/192] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:34 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:34.943070 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f95566ef-7683-4c7e-86dc-d61694fc6f14 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:34.943706 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f95566ef-7683-4c7e-86dc-d61694fc6f14 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:34.949540 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f95566ef-7683-4c7e-86dc-d61694fc6f14 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:34.950022 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f95566ef-7683-4c7e-86dc-d61694fc6f14 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:34.950458 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f95566ef-7683-4c7e-86dc-d61694fc6f14 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:34.951140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f95566ef-7683-4c7e-86dc-d61694fc6f14 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:34.952253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f95566ef-7683-4c7e-86dc-d61694fc6f14 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:34.952675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f95566ef-7683-4c7e-86dc-d61694fc6f14 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:35.083063 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f95566ef-7683-4c7e-86dc-d61694fc6f14 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:35.085283 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:35.092150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f95566ef-7683-4c7e-86dc-d61694fc6f14 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.152818 Sep 13 06:38:35.092711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 100/193] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:34 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:35.688073 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d6e5efe8-a943-4004-b258-54255a9fca92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:35.688682 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d6e5efe8-a943-4004-b258-54255a9fca92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:35.694672 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d6e5efe8-a943-4004-b258-54255a9fca92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:35.695159 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d6e5efe8-a943-4004-b258-54255a9fca92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:35.695629 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d6e5efe8-a943-4004-b258-54255a9fca92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:35.696318 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d6e5efe8-a943-4004-b258-54255a9fca92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:35.696776 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d6e5efe8-a943-4004-b258-54255a9fca92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:35.697195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d6e5efe8-a943-4004-b258-54255a9fca92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:35.831460 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d6e5efe8-a943-4004-b258-54255a9fca92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:35.839246 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d6e5efe8-a943-4004-b258-54255a9fca92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1321 microversion: 2.1 time: 0.155535 Sep 13 06:38:35.839785 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 94/194] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:35 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:36.114703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d00c3ab6-7059-4e1a-a661-6cce3250cc24 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:36.115385 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d00c3ab6-7059-4e1a-a661-6cce3250cc24 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:36.122881 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d00c3ab6-7059-4e1a-a661-6cce3250cc24 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:36.123290 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d00c3ab6-7059-4e1a-a661-6cce3250cc24 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:36.124361 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d00c3ab6-7059-4e1a-a661-6cce3250cc24 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:36.125113 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d00c3ab6-7059-4e1a-a661-6cce3250cc24 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:36.125707 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d00c3ab6-7059-4e1a-a661-6cce3250cc24 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:36.126350 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d00c3ab6-7059-4e1a-a661-6cce3250cc24 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:36.269824 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-d00c3ab6-7059-4e1a-a661-6cce3250cc24 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:36.278117 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d00c3ab6-7059-4e1a-a661-6cce3250cc24 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.167199 Sep 13 06:38:36.278783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 101/195] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:36 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:36.866445 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fb01f96f-053c-4057-a124-cf10f25aaca4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:36.868671 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-fb01f96f-053c-4057-a124-cf10f25aaca4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:36.878572 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fb01f96f-053c-4057-a124-cf10f25aaca4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:36.879580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fb01f96f-053c-4057-a124-cf10f25aaca4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:36.880785 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fb01f96f-053c-4057-a124-cf10f25aaca4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:36.881723 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fb01f96f-053c-4057-a124-cf10f25aaca4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:36.882408 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fb01f96f-053c-4057-a124-cf10f25aaca4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:36.883315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fb01f96f-053c-4057-a124-cf10f25aaca4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:37.137251 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fb01f96f-053c-4057-a124-cf10f25aaca4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:37.146146 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fb01f96f-053c-4057-a124-cf10f25aaca4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1515 microversion: 2.1 time: 0.287575 Sep 13 06:38:37.151401 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 95/196] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:36 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:37.169824 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7a2b3bb3-90b1-45ce-839e-5fa5ff39c846 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:38:37.172295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7a2b3bb3-90b1-45ce-839e-5fa5ff39c846 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:37.178475 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7a2b3bb3-90b1-45ce-839e-5fa5ff39c846 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:37.179208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7a2b3bb3-90b1-45ce-839e-5fa5ff39c846 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:37.179908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7a2b3bb3-90b1-45ce-839e-5fa5ff39c846 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:37.180805 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7a2b3bb3-90b1-45ce-839e-5fa5ff39c846 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:37.181464 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7a2b3bb3-90b1-45ce-839e-5fa5ff39c846 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:37.182063 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7a2b3bb3-90b1-45ce-839e-5fa5ff39c846 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:37.219728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-7a2b3bb3-90b1-45ce-839e-5fa5ff39c846 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lazy-loading 'flavor' on Instance uuid 558b2e47-a791-433b-902c-8b72a0a0e78f {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:38:37.305305 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-43bbee84-8ca5-40cd-a57d-ac125a745fcf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:37.306090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-43bbee84-8ca5-40cd-a57d-ac125a745fcf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:37.317636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43bbee84-8ca5-40cd-a57d-ac125a745fcf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:37.318393 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43bbee84-8ca5-40cd-a57d-ac125a745fcf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:37.319022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43bbee84-8ca5-40cd-a57d-ac125a745fcf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:37.324010 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43bbee84-8ca5-40cd-a57d-ac125a745fcf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:37.324774 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43bbee84-8ca5-40cd-a57d-ac125a745fcf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:37.325384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43bbee84-8ca5-40cd-a57d-ac125a745fcf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:37.427151 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7a2b3bb3-90b1-45ce-839e-5fa5ff39c846 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f/action" status: 200 len: 32 microversion: 2.1 time: 0.261732 Sep 13 06:38:37.441235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 102/197] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:38:37 2022] POST /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 06:38:37.452418 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-683b03db-60f2-4697-b49a-b8de62d9d46a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e73781a-f329-4222-964b-21e6910f0190"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:38:37.454912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-683b03db-60f2-4697-b49a-b8de62d9d46a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:37.462661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-683b03db-60f2-4697-b49a-b8de62d9d46a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:37.463422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-683b03db-60f2-4697-b49a-b8de62d9d46a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:37.464005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-683b03db-60f2-4697-b49a-b8de62d9d46a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:37.464997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-683b03db-60f2-4697-b49a-b8de62d9d46a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:37.465376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-683b03db-60f2-4697-b49a-b8de62d9d46a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:37.465822 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-683b03db-60f2-4697-b49a-b8de62d9d46a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:37.603137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-43bbee84-8ca5-40cd-a57d-ac125a745fcf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:37.611175 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-43bbee84-8ca5-40cd-a57d-ac125a745fcf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.309811 Sep 13 06:38:37.611770 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 96/198] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:37 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:37.616359 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3ae97ef8-0f0f-47ce-ae33-48d833cfdb26 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:37.616960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3ae97ef8-0f0f-47ce-ae33-48d833cfdb26 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:37.622488 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ae97ef8-0f0f-47ce-ae33-48d833cfdb26 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:37.622970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ae97ef8-0f0f-47ce-ae33-48d833cfdb26 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:37.623482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ae97ef8-0f0f-47ce-ae33-48d833cfdb26 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:37.624171 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ae97ef8-0f0f-47ce-ae33-48d833cfdb26 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:37.624629 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ae97ef8-0f0f-47ce-ae33-48d833cfdb26 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:37.625057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ae97ef8-0f0f-47ce-ae33-48d833cfdb26 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:37.759930 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3ae97ef8-0f0f-47ce-ae33-48d833cfdb26 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:37.770475 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3ae97ef8-0f0f-47ce-ae33-48d833cfdb26 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.157619 Sep 13 06:38:37.771057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 97/199] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:37 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:38.633498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-db3bfdc7-ae5b-428b-a394-3f981bdc7862 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:38.634115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-db3bfdc7-ae5b-428b-a394-3f981bdc7862 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:38.640599 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db3bfdc7-ae5b-428b-a394-3f981bdc7862 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:38.641079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db3bfdc7-ae5b-428b-a394-3f981bdc7862 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:38.641505 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db3bfdc7-ae5b-428b-a394-3f981bdc7862 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:38.642183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db3bfdc7-ae5b-428b-a394-3f981bdc7862 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:38.642632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db3bfdc7-ae5b-428b-a394-3f981bdc7862 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:38.643049 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db3bfdc7-ae5b-428b-a394-3f981bdc7862 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:38.766033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-db3bfdc7-ae5b-428b-a394-3f981bdc7862 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:38.773557 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-db3bfdc7-ae5b-428b-a394-3f981bdc7862 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.143879 Sep 13 06:38:38.774102 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 98/200] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:38 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:38.792943 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3a8fbf65-8fba-4446-a58a-c4e8efc5c89c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:38.793534 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3a8fbf65-8fba-4446-a58a-c4e8efc5c89c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:38.799552 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a8fbf65-8fba-4446-a58a-c4e8efc5c89c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:38.800022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a8fbf65-8fba-4446-a58a-c4e8efc5c89c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:38.800450 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a8fbf65-8fba-4446-a58a-c4e8efc5c89c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:38.801122 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a8fbf65-8fba-4446-a58a-c4e8efc5c89c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:38.801566 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a8fbf65-8fba-4446-a58a-c4e8efc5c89c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:38.801975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a8fbf65-8fba-4446-a58a-c4e8efc5c89c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:38.926638 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3a8fbf65-8fba-4446-a58a-c4e8efc5c89c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:38.934420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3a8fbf65-8fba-4446-a58a-c4e8efc5c89c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.145311 Sep 13 06:38:38.934998 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 99/201] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:38 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:39.796266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-55280e01-9bb5-4df9-8c03-fdede07923b1 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:39.796897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-55280e01-9bb5-4df9-8c03-fdede07923b1 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:39.802679 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-55280e01-9bb5-4df9-8c03-fdede07923b1 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:39.803157 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-55280e01-9bb5-4df9-8c03-fdede07923b1 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:39.803693 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-55280e01-9bb5-4df9-8c03-fdede07923b1 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:39.804371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-55280e01-9bb5-4df9-8c03-fdede07923b1 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:39.804823 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-55280e01-9bb5-4df9-8c03-fdede07923b1 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:39.805244 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-55280e01-9bb5-4df9-8c03-fdede07923b1 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:39.822725 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:39.936202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-55280e01-9bb5-4df9-8c03-fdede07923b1 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:39.943767 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-55280e01-9bb5-4df9-8c03-fdede07923b1 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.151298 Sep 13 06:38:39.944320 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 100/202] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:39 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:39.958032 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-909ad26f-59d8-4686-9a66-9f2ea73aa261 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:39.958661 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-909ad26f-59d8-4686-9a66-9f2ea73aa261 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:39.964192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-909ad26f-59d8-4686-9a66-9f2ea73aa261 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:39.964668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-909ad26f-59d8-4686-9a66-9f2ea73aa261 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:39.965096 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-909ad26f-59d8-4686-9a66-9f2ea73aa261 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:39.965780 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-909ad26f-59d8-4686-9a66-9f2ea73aa261 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:39.966233 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-909ad26f-59d8-4686-9a66-9f2ea73aa261 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:39.966652 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-909ad26f-59d8-4686-9a66-9f2ea73aa261 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:40.093971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-909ad26f-59d8-4686-9a66-9f2ea73aa261 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:40.101537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-909ad26f-59d8-4686-9a66-9f2ea73aa261 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.147094 Sep 13 06:38:40.102106 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 101/203] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:39 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:40.965818 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c358a9ff-d5b8-4930-9199-053503b4e53d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:40.966431 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c358a9ff-d5b8-4930-9199-053503b4e53d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:40.972384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c358a9ff-d5b8-4930-9199-053503b4e53d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:40.972865 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c358a9ff-d5b8-4930-9199-053503b4e53d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:40.973297 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c358a9ff-d5b8-4930-9199-053503b4e53d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:40.973980 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c358a9ff-d5b8-4930-9199-053503b4e53d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:40.974433 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c358a9ff-d5b8-4930-9199-053503b4e53d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:40.974854 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c358a9ff-d5b8-4930-9199-053503b4e53d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:41.100630 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c358a9ff-d5b8-4930-9199-053503b4e53d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:41.108770 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c358a9ff-d5b8-4930-9199-053503b4e53d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.146728 Sep 13 06:38:41.109334 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 102/204] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:40 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:41.126652 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-59753c25-04b5-4130-a586-86122dfabdcd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:41.127708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-59753c25-04b5-4130-a586-86122dfabdcd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:41.135093 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-59753c25-04b5-4130-a586-86122dfabdcd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:41.135610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-59753c25-04b5-4130-a586-86122dfabdcd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:41.136044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-59753c25-04b5-4130-a586-86122dfabdcd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:41.136731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-59753c25-04b5-4130-a586-86122dfabdcd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:41.137182 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-59753c25-04b5-4130-a586-86122dfabdcd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:41.137604 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-59753c25-04b5-4130-a586-86122dfabdcd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:41.262289 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-59753c25-04b5-4130-a586-86122dfabdcd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:41.271611 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-59753c25-04b5-4130-a586-86122dfabdcd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.151310 Sep 13 06:38:41.272184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 103/205] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:41 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:42.131503 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d15dbd41-0c8e-4e3c-8e86-56b6c1262965 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:42.132111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d15dbd41-0c8e-4e3c-8e86-56b6c1262965 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:42.137866 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d15dbd41-0c8e-4e3c-8e86-56b6c1262965 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:42.138341 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d15dbd41-0c8e-4e3c-8e86-56b6c1262965 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:42.139264 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d15dbd41-0c8e-4e3c-8e86-56b6c1262965 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:42.139974 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d15dbd41-0c8e-4e3c-8e86-56b6c1262965 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:42.140426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d15dbd41-0c8e-4e3c-8e86-56b6c1262965 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:42.140849 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d15dbd41-0c8e-4e3c-8e86-56b6c1262965 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:42.281485 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d15dbd41-0c8e-4e3c-8e86-56b6c1262965 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:42.289396 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d15dbd41-0c8e-4e3c-8e86-56b6c1262965 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.161341 Sep 13 06:38:42.290231 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 104/206] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:42 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:42.294914 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2d1a8808-c782-47f5-b869-762a0da1412e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:42.295531 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2d1a8808-c782-47f5-b869-762a0da1412e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:42.300866 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2d1a8808-c782-47f5-b869-762a0da1412e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:42.301338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2d1a8808-c782-47f5-b869-762a0da1412e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:42.301764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2d1a8808-c782-47f5-b869-762a0da1412e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:42.302431 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2d1a8808-c782-47f5-b869-762a0da1412e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:42.302876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2d1a8808-c782-47f5-b869-762a0da1412e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:42.303391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2d1a8808-c782-47f5-b869-762a0da1412e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:42.427007 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2d1a8808-c782-47f5-b869-762a0da1412e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:42.434620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2d1a8808-c782-47f5-b869-762a0da1412e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.143094 Sep 13 06:38:42.435176 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 105/207] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:42 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:43.312448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2c5e874c-8c00-4fe9-9c20-27d279c539c6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:43.313089 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2c5e874c-8c00-4fe9-9c20-27d279c539c6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:43.318729 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2c5e874c-8c00-4fe9-9c20-27d279c539c6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:43.319199 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2c5e874c-8c00-4fe9-9c20-27d279c539c6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:43.319653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2c5e874c-8c00-4fe9-9c20-27d279c539c6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:43.320327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2c5e874c-8c00-4fe9-9c20-27d279c539c6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:43.320771 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2c5e874c-8c00-4fe9-9c20-27d279c539c6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:43.321183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2c5e874c-8c00-4fe9-9c20-27d279c539c6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:43.446910 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2c5e874c-8c00-4fe9-9c20-27d279c539c6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:43.455090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2c5e874c-8c00-4fe9-9c20-27d279c539c6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.146579 Sep 13 06:38:43.455678 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 106/208] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:43 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:38:43.459950 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-304e88d6-b8c1-4b4f-a20f-f681e7cd37b7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:43.460574 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-304e88d6-b8c1-4b4f-a20f-f681e7cd37b7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:43.465909 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-304e88d6-b8c1-4b4f-a20f-f681e7cd37b7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:43.466385 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-304e88d6-b8c1-4b4f-a20f-f681e7cd37b7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:43.466813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-304e88d6-b8c1-4b4f-a20f-f681e7cd37b7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:43.468070 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-304e88d6-b8c1-4b4f-a20f-f681e7cd37b7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:43.468523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-304e88d6-b8c1-4b4f-a20f-f681e7cd37b7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:43.468959 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-304e88d6-b8c1-4b4f-a20f-f681e7cd37b7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:43.598379 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-304e88d6-b8c1-4b4f-a20f-f681e7cd37b7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:43.606021 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-304e88d6-b8c1-4b4f-a20f-f681e7cd37b7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.149411 Sep 13 06:38:43.606581 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 107/209] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:43 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:44.300845 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-683b03db-60f2-4697-b49a-b8de62d9d46a tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "POST /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.857433 Sep 13 06:38:44.304901 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 103/210] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:38:37 2022] POST /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2/os-volume_attachments => generated 194 bytes in 6863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:38:44.478848 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a2eafd84-f730-45e4-ba8e-434e0e36effa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:44.479567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a2eafd84-f730-45e4-ba8e-434e0e36effa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:44.486088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a2eafd84-f730-45e4-ba8e-434e0e36effa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:44.486636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a2eafd84-f730-45e4-ba8e-434e0e36effa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:44.487131 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a2eafd84-f730-45e4-ba8e-434e0e36effa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:44.487958 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a2eafd84-f730-45e4-ba8e-434e0e36effa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:44.488408 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a2eafd84-f730-45e4-ba8e-434e0e36effa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:44.488830 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a2eafd84-f730-45e4-ba8e-434e0e36effa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:44.632312 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3c99839c-1f8f-468f-9066-4f17cf6e015a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:44.633157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3c99839c-1f8f-468f-9066-4f17cf6e015a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:44.644117 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3c99839c-1f8f-468f-9066-4f17cf6e015a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:44.645824 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3c99839c-1f8f-468f-9066-4f17cf6e015a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:44.647501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3c99839c-1f8f-468f-9066-4f17cf6e015a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:44.648449 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3c99839c-1f8f-468f-9066-4f17cf6e015a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:44.649974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3c99839c-1f8f-468f-9066-4f17cf6e015a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:44.651194 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3c99839c-1f8f-468f-9066-4f17cf6e015a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:44.730971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a2eafd84-f730-45e4-ba8e-434e0e36effa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:44.744285 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a2eafd84-f730-45e4-ba8e-434e0e36effa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1368 microversion: 2.1 time: 0.266685 Sep 13 06:38:44.759895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 108/211] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:44 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1368 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:44.877032 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3c99839c-1f8f-468f-9066-4f17cf6e015a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:44.884801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3c99839c-1f8f-468f-9066-4f17cf6e015a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.257980 Sep 13 06:38:44.885550 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 104/212] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:44 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:45.766797 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ab644916-e368-4e1f-9e85-96d2ab6b44cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:45.767424 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ab644916-e368-4e1f-9e85-96d2ab6b44cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:45.773497 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab644916-e368-4e1f-9e85-96d2ab6b44cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:45.773985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab644916-e368-4e1f-9e85-96d2ab6b44cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:45.774413 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab644916-e368-4e1f-9e85-96d2ab6b44cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:45.775090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab644916-e368-4e1f-9e85-96d2ab6b44cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:45.775575 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab644916-e368-4e1f-9e85-96d2ab6b44cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:45.776031 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab644916-e368-4e1f-9e85-96d2ab6b44cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:45.909781 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6becde4a-bd7f-4504-a9ad-e5f197ad4de8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:45.910444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6becde4a-bd7f-4504-a9ad-e5f197ad4de8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:45.919595 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6becde4a-bd7f-4504-a9ad-e5f197ad4de8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:45.920762 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6becde4a-bd7f-4504-a9ad-e5f197ad4de8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:45.931716 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6becde4a-bd7f-4504-a9ad-e5f197ad4de8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:45.932538 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6becde4a-bd7f-4504-a9ad-e5f197ad4de8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:45.933023 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6becde4a-bd7f-4504-a9ad-e5f197ad4de8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:45.933461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6becde4a-bd7f-4504-a9ad-e5f197ad4de8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:45.996761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ab644916-e368-4e1f-9e85-96d2ab6b44cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:46.005371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ab644916-e368-4e1f-9e85-96d2ab6b44cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1558 microversion: 2.1 time: 0.242405 Sep 13 06:38:46.006032 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 109/213] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:45 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1558 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:46.029579 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a0df110e-b697-4c5b-a79a-bf96ce485b63 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:46.030700 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a0df110e-b697-4c5b-a79a-bf96ce485b63 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:46.036083 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0df110e-b697-4c5b-a79a-bf96ce485b63 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:46.036561 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0df110e-b697-4c5b-a79a-bf96ce485b63 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:46.037190 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0df110e-b697-4c5b-a79a-bf96ce485b63 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:46.037840 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0df110e-b697-4c5b-a79a-bf96ce485b63 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:46.038292 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0df110e-b697-4c5b-a79a-bf96ce485b63 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:46.038707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a0df110e-b697-4c5b-a79a-bf96ce485b63 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:46.088120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6becde4a-bd7f-4504-a9ad-e5f197ad4de8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:46.097485 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6becde4a-bd7f-4504-a9ad-e5f197ad4de8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.191669 Sep 13 06:38:46.098277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 105/214] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:45 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:46.160071 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a0df110e-b697-4c5b-a79a-bf96ce485b63 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134209 Sep 13 06:38:46.160745 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 110/215] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Sep 13 06:38:46 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:38:47.121286 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-470e7a94-e0cc-4d98-a0f2-14b67aebde53 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:47.122459 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-470e7a94-e0cc-4d98-a0f2-14b67aebde53 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:47.129919 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-470e7a94-e0cc-4d98-a0f2-14b67aebde53 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:47.130400 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-470e7a94-e0cc-4d98-a0f2-14b67aebde53 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:47.131032 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-470e7a94-e0cc-4d98-a0f2-14b67aebde53 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:47.132045 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-470e7a94-e0cc-4d98-a0f2-14b67aebde53 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:47.132664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-470e7a94-e0cc-4d98-a0f2-14b67aebde53 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:47.133122 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-470e7a94-e0cc-4d98-a0f2-14b67aebde53 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:47.298783 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-6ea0e2fc-fc90-4228-bf95-073bcc6acb6d req-df45cf4f-f948-43f9-8dbe-c21618e81a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af9e76b-6689-431b-a4c2-2d681d4098ba", "tag": "3c3acc09-6c0d-4f36-8f12-849b52e0123f"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:38:47.299322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-470e7a94-e0cc-4d98-a0f2-14b67aebde53 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:47.308895 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-470e7a94-e0cc-4d98-a0f2-14b67aebde53 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.191293 Sep 13 06:38:47.310178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 106/216] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:47 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:47.323088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-6ea0e2fc-fc90-4228-bf95-073bcc6acb6d req-df45cf4f-f948-43f9-8dbe-c21618e81a2f service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:47.324933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-6ea0e2fc-fc90-4228-bf95-073bcc6acb6d req-df45cf4f-f948-43f9-8dbe-c21618e81a2f service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:47.325517 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-6ea0e2fc-fc90-4228-bf95-073bcc6acb6d req-df45cf4f-f948-43f9-8dbe-c21618e81a2f service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:47.341662 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-6ea0e2fc-fc90-4228-bf95-073bcc6acb6d req-df45cf4f-f948-43f9-8dbe-c21618e81a2f service nova] Creating event network-changed:3c3acc09-6c0d-4f36-8f12-849b52e0123f for instance 1af9e76b-6689-431b-a4c2-2d681d4098ba on hv-cinder-85638 Sep 13 06:38:47.348126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-6ea0e2fc-fc90-4228-bf95-073bcc6acb6d req-df45cf4f-f948-43f9-8dbe-c21618e81a2f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053509 Sep 13 06:38:47.348741 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 111/217] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:38:48.335586 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-655ec006-2bf4-4d4d-9a24-d57919c74db7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:48.336813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-655ec006-2bf4-4d4d-9a24-d57919c74db7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:48.343637 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-655ec006-2bf4-4d4d-9a24-d57919c74db7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:48.344402 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-655ec006-2bf4-4d4d-9a24-d57919c74db7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:48.345035 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-655ec006-2bf4-4d4d-9a24-d57919c74db7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:48.345947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-655ec006-2bf4-4d4d-9a24-d57919c74db7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:48.346599 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-655ec006-2bf4-4d4d-9a24-d57919c74db7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:48.347199 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-655ec006-2bf4-4d4d-9a24-d57919c74db7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:48.496854 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-655ec006-2bf4-4d4d-9a24-d57919c74db7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:48.508848 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-655ec006-2bf4-4d4d-9a24-d57919c74db7 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.177396 Sep 13 06:38:48.509709 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 107/218] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:48 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:49.533053 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c9c224f4-3b12-430a-b4d5-e201eb192857 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:49.534210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c9c224f4-3b12-430a-b4d5-e201eb192857 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:49.540399 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c9c224f4-3b12-430a-b4d5-e201eb192857 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:49.540874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c9c224f4-3b12-430a-b4d5-e201eb192857 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:49.541300 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c9c224f4-3b12-430a-b4d5-e201eb192857 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:49.542051 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c9c224f4-3b12-430a-b4d5-e201eb192857 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:49.542509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c9c224f4-3b12-430a-b4d5-e201eb192857 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:49.542923 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c9c224f4-3b12-430a-b4d5-e201eb192857 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:49.684373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c9c224f4-3b12-430a-b4d5-e201eb192857 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:49.693316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c9c224f4-3b12-430a-b4d5-e201eb192857 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.164731 Sep 13 06:38:49.693909 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 112/219] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:49 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:50.717223 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1ecc1699-a5ef-45e0-b923-f77014b7e958 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:50.717822 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1ecc1699-a5ef-45e0-b923-f77014b7e958 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:50.724235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ecc1699-a5ef-45e0-b923-f77014b7e958 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:50.724711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ecc1699-a5ef-45e0-b923-f77014b7e958 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:50.725138 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ecc1699-a5ef-45e0-b923-f77014b7e958 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:50.725813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ecc1699-a5ef-45e0-b923-f77014b7e958 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:50.726262 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ecc1699-a5ef-45e0-b923-f77014b7e958 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:50.726679 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ecc1699-a5ef-45e0-b923-f77014b7e958 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:50.863199 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1ecc1699-a5ef-45e0-b923-f77014b7e958 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:50.870841 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1ecc1699-a5ef-45e0-b923-f77014b7e958 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.157465 Sep 13 06:38:50.871425 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 108/220] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:50 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:51.894032 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-249d0a39-888a-4203-ad1c-283966b43465 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:51.894640 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-249d0a39-888a-4203-ad1c-283966b43465 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:51.900721 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-249d0a39-888a-4203-ad1c-283966b43465 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:51.901200 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-249d0a39-888a-4203-ad1c-283966b43465 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:51.901632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-249d0a39-888a-4203-ad1c-283966b43465 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:51.902313 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-249d0a39-888a-4203-ad1c-283966b43465 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:51.902765 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-249d0a39-888a-4203-ad1c-283966b43465 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:51.903187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-249d0a39-888a-4203-ad1c-283966b43465 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:52.034187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-249d0a39-888a-4203-ad1c-283966b43465 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:52.042004 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-249d0a39-888a-4203-ad1c-283966b43465 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.151867 Sep 13 06:38:52.042567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 113/221] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:51 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:53.065195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4cca5d17-1e07-40ac-a923-23e1e7068673 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:53.065702 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4cca5d17-1e07-40ac-a923-23e1e7068673 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:53.072172 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4cca5d17-1e07-40ac-a923-23e1e7068673 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:53.072686 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4cca5d17-1e07-40ac-a923-23e1e7068673 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:53.073121 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4cca5d17-1e07-40ac-a923-23e1e7068673 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:53.073809 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4cca5d17-1e07-40ac-a923-23e1e7068673 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:53.074263 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4cca5d17-1e07-40ac-a923-23e1e7068673 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:53.074682 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4cca5d17-1e07-40ac-a923-23e1e7068673 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:53.214477 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4cca5d17-1e07-40ac-a923-23e1e7068673 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:53.222662 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4cca5d17-1e07-40ac-a923-23e1e7068673 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.161398 Sep 13 06:38:53.223229 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 109/222] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:53 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:54.245866 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1ebfc12a-a3eb-426c-bd8c-3a2ebfc1706f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:54.246471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1ebfc12a-a3eb-426c-bd8c-3a2ebfc1706f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:54.248596 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=70 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:54.253694 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ebfc12a-a3eb-426c-bd8c-3a2ebfc1706f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:54.254168 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ebfc12a-a3eb-426c-bd8c-3a2ebfc1706f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:54.254590 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ebfc12a-a3eb-426c-bd8c-3a2ebfc1706f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:54.255269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ebfc12a-a3eb-426c-bd8c-3a2ebfc1706f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:54.255742 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ebfc12a-a3eb-426c-bd8c-3a2ebfc1706f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:54.256161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ebfc12a-a3eb-426c-bd8c-3a2ebfc1706f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:54.384565 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1ebfc12a-a3eb-426c-bd8c-3a2ebfc1706f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:54.392336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1ebfc12a-a3eb-426c-bd8c-3a2ebfc1706f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.150287 Sep 13 06:38:54.392899 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 114/223] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:54 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:55.414927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f712f4f4-2030-4e88-bf44-ea32d107e726 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:55.415709 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f712f4f4-2030-4e88-bf44-ea32d107e726 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:55.421981 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f712f4f4-2030-4e88-bf44-ea32d107e726 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:55.422509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f712f4f4-2030-4e88-bf44-ea32d107e726 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:55.422990 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f712f4f4-2030-4e88-bf44-ea32d107e726 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:55.423739 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f712f4f4-2030-4e88-bf44-ea32d107e726 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:55.424235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f712f4f4-2030-4e88-bf44-ea32d107e726 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:55.424695 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f712f4f4-2030-4e88-bf44-ea32d107e726 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:55.559098 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f712f4f4-2030-4e88-bf44-ea32d107e726 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:55.566692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f712f4f4-2030-4e88-bf44-ea32d107e726 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.156088 Sep 13 06:38:55.567254 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 110/224] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:55 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:56.592607 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9a162fda-f8f3-4f6b-867c-ef83a275b0f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:56.593176 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9a162fda-f8f3-4f6b-867c-ef83a275b0f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:56.599278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9a162fda-f8f3-4f6b-867c-ef83a275b0f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:56.599795 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9a162fda-f8f3-4f6b-867c-ef83a275b0f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:56.600235 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9a162fda-f8f3-4f6b-867c-ef83a275b0f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:56.600923 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9a162fda-f8f3-4f6b-867c-ef83a275b0f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:56.601375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9a162fda-f8f3-4f6b-867c-ef83a275b0f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:56.601918 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9a162fda-f8f3-4f6b-867c-ef83a275b0f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:57.063310 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9a162fda-f8f3-4f6b-867c-ef83a275b0f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:57.072417 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9a162fda-f8f3-4f6b-867c-ef83a275b0f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.485276 Sep 13 06:38:57.073072 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 115/225] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:56 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:58.099208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-668fb8e0-bc2f-4ec2-ba6b-f27b1f168893 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:58.099837 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-668fb8e0-bc2f-4ec2-ba6b-f27b1f168893 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:58.108683 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-668fb8e0-bc2f-4ec2-ba6b-f27b1f168893 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:58.109914 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-668fb8e0-bc2f-4ec2-ba6b-f27b1f168893 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:58.110734 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-668fb8e0-bc2f-4ec2-ba6b-f27b1f168893 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:58.111690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-668fb8e0-bc2f-4ec2-ba6b-f27b1f168893 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:58.112329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-668fb8e0-bc2f-4ec2-ba6b-f27b1f168893 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:58.112934 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-668fb8e0-bc2f-4ec2-ba6b-f27b1f168893 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:58.268625 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-668fb8e0-bc2f-4ec2-ba6b-f27b1f168893 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:58.276561 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-668fb8e0-bc2f-4ec2-ba6b-f27b1f168893 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.181150 Sep 13 06:38:58.277120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 111/226] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:58 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:58.572942 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b45b0021-6b74-4c5d-8fe5-69a43597d389 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:58.573814 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b45b0021-6b74-4c5d-8fe5-69a43597d389 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:58.580755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b45b0021-6b74-4c5d-8fe5-69a43597d389 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:58.581646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b45b0021-6b74-4c5d-8fe5-69a43597d389 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:58.582286 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b45b0021-6b74-4c5d-8fe5-69a43597d389 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:58.583185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b45b0021-6b74-4c5d-8fe5-69a43597d389 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:58.583818 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b45b0021-6b74-4c5d-8fe5-69a43597d389 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:58.584514 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b45b0021-6b74-4c5d-8fe5-69a43597d389 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:58.613255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b45b0021-6b74-4c5d-8fe5-69a43597d389 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:38:58.675194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:58.730788 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b45b0021-6b74-4c5d-8fe5-69a43597d389 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 204 len: 0 microversion: 2.1 time: 0.161258 Sep 13 06:38:58.734546 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 116/227] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:38:58 2022] DELETE /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 06:38:58.742280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fb74c6c9-176e-4b7f-9f27-7d7876f61c4b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:58.743144 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fb74c6c9-176e-4b7f-9f27-7d7876f61c4b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:58.751300 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb74c6c9-176e-4b7f-9f27-7d7876f61c4b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:58.751857 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb74c6c9-176e-4b7f-9f27-7d7876f61c4b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:58.752578 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb74c6c9-176e-4b7f-9f27-7d7876f61c4b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:58.753580 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb74c6c9-176e-4b7f-9f27-7d7876f61c4b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:58.754221 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb74c6c9-176e-4b7f-9f27-7d7876f61c4b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:58.754849 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb74c6c9-176e-4b7f-9f27-7d7876f61c4b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:59.082196 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fb74c6c9-176e-4b7f-9f27-7d7876f61c4b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:59.108843 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fb74c6c9-176e-4b7f-9f27-7d7876f61c4b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1554 microversion: 2.1 time: 0.372497 Sep 13 06:38:59.124800 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 112/228] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:58 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1554 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:38:59.308295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-907c8b69-bac2-4851-bb09-bc1bf79d42bf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:38:59.309100 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-907c8b69-bac2-4851-bb09-bc1bf79d42bf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:38:59.317177 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-907c8b69-bac2-4851-bb09-bc1bf79d42bf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:59.317833 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-907c8b69-bac2-4851-bb09-bc1bf79d42bf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:59.318355 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-907c8b69-bac2-4851-bb09-bc1bf79d42bf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:59.319509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-907c8b69-bac2-4851-bb09-bc1bf79d42bf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:38:59.320248 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-907c8b69-bac2-4851-bb09-bc1bf79d42bf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:38:59.320899 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-907c8b69-bac2-4851-bb09-bc1bf79d42bf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:38:59.482513 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-907c8b69-bac2-4851-bb09-bc1bf79d42bf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:38:59.492024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-907c8b69-bac2-4851-bb09-bc1bf79d42bf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.191558 Sep 13 06:38:59.493046 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 117/229] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:38:59 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:00.134903 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a4f6052d-368c-40b5-bd12-951f7347f31b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:00.139467 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a4f6052d-368c-40b5-bd12-951f7347f31b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:00.146444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4f6052d-368c-40b5-bd12-951f7347f31b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:00.147263 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4f6052d-368c-40b5-bd12-951f7347f31b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:00.147858 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4f6052d-368c-40b5-bd12-951f7347f31b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:00.148830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4f6052d-368c-40b5-bd12-951f7347f31b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:00.149357 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4f6052d-368c-40b5-bd12-951f7347f31b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:00.149852 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4f6052d-368c-40b5-bd12-951f7347f31b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:00.410449 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a4f6052d-368c-40b5-bd12-951f7347f31b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:00.419287 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a4f6052d-368c-40b5-bd12-951f7347f31b tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1554 microversion: 2.1 time: 0.289004 Sep 13 06:39:00.436094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 113/230] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:00 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:00.517469 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9ef429de-514b-4274-8a55-02bf64bceda3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:00.518124 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9ef429de-514b-4274-8a55-02bf64bceda3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:00.524450 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9ef429de-514b-4274-8a55-02bf64bceda3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:00.524939 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9ef429de-514b-4274-8a55-02bf64bceda3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:00.525553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9ef429de-514b-4274-8a55-02bf64bceda3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:00.526518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9ef429de-514b-4274-8a55-02bf64bceda3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:00.527552 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9ef429de-514b-4274-8a55-02bf64bceda3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:00.528261 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9ef429de-514b-4274-8a55-02bf64bceda3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:00.837571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9ef429de-514b-4274-8a55-02bf64bceda3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:00.846536 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9ef429de-514b-4274-8a55-02bf64bceda3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.333209 Sep 13 06:39:00.847120 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 118/231] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:00 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:01.458190 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2a5b42d0-9d5e-4ae0-a475-ef29e4d05cb8 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:01.459556 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2a5b42d0-9d5e-4ae0-a475-ef29e4d05cb8 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:01.470429 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=36 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:01.475432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2a5b42d0-9d5e-4ae0-a475-ef29e4d05cb8 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:01.478189 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2a5b42d0-9d5e-4ae0-a475-ef29e4d05cb8 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:01.478627 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2a5b42d0-9d5e-4ae0-a475-ef29e4d05cb8 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:01.502959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2a5b42d0-9d5e-4ae0-a475-ef29e4d05cb8 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:01.504299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2a5b42d0-9d5e-4ae0-a475-ef29e4d05cb8 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:01.504957 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2a5b42d0-9d5e-4ae0-a475-ef29e4d05cb8 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:01.512074 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:01.691954 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2a5b42d0-9d5e-4ae0-a475-ef29e4d05cb8 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:01.701141 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2a5b42d0-9d5e-4ae0-a475-ef29e4d05cb8 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1554 microversion: 2.1 time: 0.246139 Sep 13 06:39:01.702216 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 114/232] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:01 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:01.874185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2ae22d61-bf26-434f-b4cf-41c62ed693b2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:01.875006 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2ae22d61-bf26-434f-b4cf-41c62ed693b2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:01.891389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ae22d61-bf26-434f-b4cf-41c62ed693b2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:01.891389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ae22d61-bf26-434f-b4cf-41c62ed693b2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:01.891389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ae22d61-bf26-434f-b4cf-41c62ed693b2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:01.891389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ae22d61-bf26-434f-b4cf-41c62ed693b2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:01.891874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ae22d61-bf26-434f-b4cf-41c62ed693b2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:01.891874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ae22d61-bf26-434f-b4cf-41c62ed693b2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:02.318470 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2ae22d61-bf26-434f-b4cf-41c62ed693b2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:02.327215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2ae22d61-bf26-434f-b4cf-41c62ed693b2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.459426 Sep 13 06:39:02.328278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 119/233] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:01 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:02.724814 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-49e0f5ce-59c7-4bd3-bbec-c4aa2abce35d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:02.725423 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-49e0f5ce-59c7-4bd3-bbec-c4aa2abce35d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:02.740952 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-49e0f5ce-59c7-4bd3-bbec-c4aa2abce35d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:02.741968 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-49e0f5ce-59c7-4bd3-bbec-c4aa2abce35d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:02.742667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-49e0f5ce-59c7-4bd3-bbec-c4aa2abce35d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:02.743580 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-49e0f5ce-59c7-4bd3-bbec-c4aa2abce35d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:02.745356 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-49e0f5ce-59c7-4bd3-bbec-c4aa2abce35d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:02.745939 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-49e0f5ce-59c7-4bd3-bbec-c4aa2abce35d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:02.807022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-7242a123-4f03-41fe-b9bc-68ceacb19796 req-c4743a62-5bd0-4278-806b-31d1129fed92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9fa6279-bb1f-4dca-b762-cde8a7310fb2", "name": "network-vif-deleted", "tag": "a00bdd4f-e8d5-4657-812d-5a3531fc68eb"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:39:02.826378 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-7242a123-4f03-41fe-b9bc-68ceacb19796 req-c4743a62-5bd0-4278-806b-31d1129fed92 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:02.830581 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-7242a123-4f03-41fe-b9bc-68ceacb19796 req-c4743a62-5bd0-4278-806b-31d1129fed92 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:02.831220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-7242a123-4f03-41fe-b9bc-68ceacb19796 req-c4743a62-5bd0-4278-806b-31d1129fed92 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:02.831817 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-49e0f5ce-59c7-4bd3-bbec-c4aa2abce35d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:02.842064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-49e0f5ce-59c7-4bd3-bbec-c4aa2abce35d tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1512 microversion: 2.1 time: 0.121208 Sep 13 06:39:02.842723 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 115/234] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:02 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1512 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:02.876085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-7242a123-4f03-41fe-b9bc-68ceacb19796 req-c4743a62-5bd0-4278-806b-31d1129fed92 service nova] Creating event network-vif-deleted:a00bdd4f-e8d5-4657-812d-5a3531fc68eb for instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 on hv-cinder-85638 Sep 13 06:39:02.885032 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-7242a123-4f03-41fe-b9bc-68ceacb19796 req-c4743a62-5bd0-4278-806b-31d1129fed92 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080071 Sep 13 06:39:02.886388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 120/235] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:39:03.218517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2102011636", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:39:03.315719 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] validate_networks() for None {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:39:03.364215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e9922afa-9e9e-47f6-94f9-96126b4a7694 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:03.365009 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e9922afa-9e9e-47f6-94f9-96126b4a7694 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:03.379905 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e9922afa-9e9e-47f6-94f9-96126b4a7694 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:03.383804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e9922afa-9e9e-47f6-94f9-96126b4a7694 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:03.384396 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e9922afa-9e9e-47f6-94f9-96126b4a7694 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:03.393226 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e9922afa-9e9e-47f6-94f9-96126b4a7694 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:03.394759 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e9922afa-9e9e-47f6-94f9-96126b4a7694 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:03.401190 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e9922afa-9e9e-47f6-94f9-96126b4a7694 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:03.796118 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:39:03.796629 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:39:03.798597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:39:03.799189 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:39:03.799784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:39:03.810335 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:03.811232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:03.811869 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:03.812597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:03.813051 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:03.813462 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:03.834737 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Getting quotas for project e05975066db346c7a032f273df0744e1. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:39:03.839022 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Getting quotas for user 08b1c3face934a748d51b6dd2cffec4b and project e05975066db346c7a032f273df0744e1. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:39:03.852673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:39:03.855196 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:39:03.909196 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-545d0170-786e-44c9-9768-c531692348c7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696560 Sep 13 06:39:03.910445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 116/236] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:39:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:39:03.920568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:03.921350 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:03.930702 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:03.931283 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:03.931803 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:03.932581 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:03.933157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:03.933678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:03.980244 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:03.980991 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:03.981801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:03.982402 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lazy-loading 'fault' on Instance uuid f9fa6279-bb1f-4dca-b762-cde8a7310fb2 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:39:04.029141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e9922afa-9e9e-47f6-94f9-96126b4a7694 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:04.036789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c95396abaf14d5c8b217772fc52f28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe32000613545748673eaa2633ff1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:04.043065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e9922afa-9e9e-47f6-94f9-96126b4a7694 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.693191 Sep 13 06:39:04.044870 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 121/237] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:03 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:04.051330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8884b8a4-49fb-47d9-8d81-32a721ffe59b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:04.053232 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8884b8a4-49fb-47d9-8d81-32a721ffe59b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:04.058252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e1813d7d-d534-4f6a-979b-51906f167ae3 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 200 len: 1351 microversion: 2.1 time: 0.146435 Sep 13 06:39:04.072566 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 117/238] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:03 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 1351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:04.143232 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8884b8a4-49fb-47d9-8d81-32a721ffe59b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:04.150863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8884b8a4-49fb-47d9-8d81-32a721ffe59b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1215 microversion: 2.1 time: 0.103693 Sep 13 06:39:04.151494 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 122/239] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:04 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:05.082925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-443dea12-8d69-42c2-b41c-08152793d680 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:05.083585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-443dea12-8d69-42c2-b41c-08152793d680 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:05.090376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-443dea12-8d69-42c2-b41c-08152793d680 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:05.090873 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-443dea12-8d69-42c2-b41c-08152793d680 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:05.091564 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-443dea12-8d69-42c2-b41c-08152793d680 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:05.092448 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-443dea12-8d69-42c2-b41c-08152793d680 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:05.093689 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-443dea12-8d69-42c2-b41c-08152793d680 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:05.097055 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-443dea12-8d69-42c2-b41c-08152793d680 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:05.099955 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:05.100777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:05.110445 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:05.111200 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:05.111845 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:05.113286 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:05.113931 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:05.114530 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:05.134469 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] HTTP exception thrown: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Request method failure captured: Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 HTTP/1.1 Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUtzrvxhU4YMKT9gHJZjuyXha6v5hz5sWs-JTG1GJH1x-hcJY1X5j4r-0y71W21OC2Uc0m3XdRwUDlGhCiJtjMwGl10kDLgq170jmjdbQ34hp7PqCl82lVf77mW6nRrtauSXMqcFrWYa8aoPteWV4dbDbjcaeva1fF7XEwqe13Okoo Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: efe32000613545748673eaa2633ff1ea Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:39:05.139634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/efe32000613545748673eaa2633ff1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/efe32000613545748673eaa2633ff1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/efe32000613545748673eaa2633ff1ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_efe32000613545748673eaa2633ff1ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: efe32000613545748673eaa2633ff1ea Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-DeleteServersTestJSON-1518461658-project Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 5c95396abaf14d5c8b217772fc52f28b Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-DeleteServersTestJSON-1518461658-project Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:05.141058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': 'f9fa6279-bb1f-4dca-b762-cde8a7310fb2'} Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:39:05.141863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:05.143088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:05.144318 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Returning 404 to user: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:39:05.144318 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1b5f407b-7bc3-42bf-9951-c88211f58e50 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 404 len: 111 microversion: 2.1 time: 0.049851 Sep 13 06:39:05.148189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 123/240] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:05 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:39:05.181755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e456c8b9-8d72-442e-81cf-3238666978d6 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:05.182513 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e456c8b9-8d72-442e-81cf-3238666978d6 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:05.196315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e456c8b9-8d72-442e-81cf-3238666978d6 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:05.196858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e456c8b9-8d72-442e-81cf-3238666978d6 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:05.197481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e456c8b9-8d72-442e-81cf-3238666978d6 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:05.198337 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e456c8b9-8d72-442e-81cf-3238666978d6 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:05.198933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e456c8b9-8d72-442e-81cf-3238666978d6 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:05.199528 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e456c8b9-8d72-442e-81cf-3238666978d6 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:05.296740 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e456c8b9-8d72-442e-81cf-3238666978d6 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:05.301351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-443dea12-8d69-42c2-b41c-08152793d680 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:05.305368 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e456c8b9-8d72-442e-81cf-3238666978d6 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1267 microversion: 2.1 time: 0.127809 Sep 13 06:39:05.308963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 124/241] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:05 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:05.310719 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-443dea12-8d69-42c2-b41c-08152793d680 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.231507 Sep 13 06:39:05.311648 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 118/242] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:05 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:05.314567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:05.317188 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:05.324453 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:05.325195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:05.326396 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:05.327352 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:05.328178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:05.328968 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:05.343301 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] HTTP exception thrown: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Request method failure captured: Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2/os-volume_attachments HTTP/1.1 Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUtzrvxhU4YMKT9gHJZjuyXha6v5hz5sWs-JTG1GJH1x-hcJY1X5j4r-0y71W21OC2Uc0m3XdRwUDlGhCiJtjMwGl10kDLgq170jmjdbQ34hp7PqCl82lVf77mW6nRrtauSXMqcFrWYa8aoPteWV4dbDbjcaeva1fF7XEwqe13Okoo Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: efe32000613545748673eaa2633ff1ea Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:39:05.345271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/efe32000613545748673eaa2633ff1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/efe32000613545748673eaa2633ff1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/efe32000613545748673eaa2633ff1ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_efe32000613545748673eaa2633ff1ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: efe32000613545748673eaa2633ff1ea Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-DeleteServersTestJSON-1518461658-project Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 5c95396abaf14d5c8b217772fc52f28b Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-DeleteServersTestJSON-1518461658-project Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:05.346481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'server_id': 'f9fa6279-bb1f-4dca-b762-cde8a7310fb2'} Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:39:05.347456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:05.348504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:05.349566 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Returning 404 to user: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:39:05.349566 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-edaa193e-70c2-423f-8cfb-dd3048bef884 tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036422 Sep 13 06:39:05.349566 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 125/243] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:39:05 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:39:06.331238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-703f4658-68e5-4405-9ae7-d4d047beb585 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:06.333303 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-703f4658-68e5-4405-9ae7-d4d047beb585 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:06.338562 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-51f03cef-a30f-427f-9b13-a29334ff4321 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:06.339745 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-51f03cef-a30f-427f-9b13-a29334ff4321 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:06.350239 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51f03cef-a30f-427f-9b13-a29334ff4321 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:06.352685 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-703f4658-68e5-4405-9ae7-d4d047beb585 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:06.353857 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51f03cef-a30f-427f-9b13-a29334ff4321 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:06.354468 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51f03cef-a30f-427f-9b13-a29334ff4321 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:06.355997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-703f4658-68e5-4405-9ae7-d4d047beb585 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:06.356168 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51f03cef-a30f-427f-9b13-a29334ff4321 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:06.356823 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51f03cef-a30f-427f-9b13-a29334ff4321 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:06.357432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-703f4658-68e5-4405-9ae7-d4d047beb585 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:06.358009 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51f03cef-a30f-427f-9b13-a29334ff4321 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:06.358887 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-703f4658-68e5-4405-9ae7-d4d047beb585 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:06.363198 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-703f4658-68e5-4405-9ae7-d4d047beb585 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:06.364203 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-703f4658-68e5-4405-9ae7-d4d047beb585 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:06.494338 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-703f4658-68e5-4405-9ae7-d4d047beb585 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:06.502888 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-703f4658-68e5-4405-9ae7-d4d047beb585 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1273 microversion: 2.1 time: 0.175471 Sep 13 06:39:06.503790 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 119/244] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:06 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1273 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:06.629398 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-51f03cef-a30f-427f-9b13-a29334ff4321 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:06.632342 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:06.634207 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:06.640228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-51f03cef-a30f-427f-9b13-a29334ff4321 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.305291 Sep 13 06:39:06.645380 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 126/245] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:06 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:06.653214 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:06.654428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:06.655007 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:06.655907 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:06.656601 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:06.657415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:06.677312 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] HTTP exception thrown: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Request method failure captured: Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: DELETE /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 HTTP/1.1 Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUtzrvxhU4YMKT9gHJZjuyXha6v5hz5sWs-JTG1GJH1x-hcJY1X5j4r-0y71W21OC2Uc0m3XdRwUDlGhCiJtjMwGl10kDLgq170jmjdbQ34hp7PqCl82lVf77mW6nRrtauSXMqcFrWYa8aoPteWV4dbDbjcaeva1fF7XEwqe13Okoo Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: efe32000613545748673eaa2633ff1ea Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:39:06.689175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/efe32000613545748673eaa2633ff1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/efe32000613545748673eaa2633ff1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/efe32000613545748673eaa2633ff1ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_efe32000613545748673eaa2633ff1ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: efe32000613545748673eaa2633ff1ea Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-DeleteServersTestJSON-1518461658-project Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 5c95396abaf14d5c8b217772fc52f28b Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-DeleteServersTestJSON-1518461658-project Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:06.690533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'f9fa6279-bb1f-4dca-b762-cde8a7310fb2'} Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:39:06.691235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:06.692343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:06.696125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Returning 404 to user: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:39:06.697631 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8433a02d-756e-4df6-98a9-5447c5ee6d4f tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 404 len: 111 microversion: 2.1 time: 0.078183 Sep 13 06:39:06.702428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 120/246] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:39:06 2022] DELETE /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:39:06.707203 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:06.707848 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] [instance: f9fa6279-bb1f-4dca-b762-cde8a7310fb2] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:06.714282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:06.714753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:06.715439 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:06.716388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:06.716984 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:06.717610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:06.733321 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] HTTP exception thrown: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Request method failure captured: Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 HTTP/1.1 Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUtzrvxhU4YMKT9gHJZjuyXha6v5hz5sWs-JTG1GJH1x-hcJY1X5j4r-0y71W21OC2Uc0m3XdRwUDlGhCiJtjMwGl10kDLgq170jmjdbQ34hp7PqCl82lVf77mW6nRrtauSXMqcFrWYa8aoPteWV4dbDbjcaeva1fF7XEwqe13Okoo Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: efe32000613545748673eaa2633ff1ea Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:39:06.735281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/efe32000613545748673eaa2633ff1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/efe32000613545748673eaa2633ff1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/efe32000613545748673eaa2633ff1ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_efe32000613545748673eaa2633ff1ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: efe32000613545748673eaa2633ff1ea Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-DeleteServersTestJSON-1518461658 Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-DeleteServersTestJSON-1518461658-project Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 5c95396abaf14d5c8b217772fc52f28b Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-DeleteServersTestJSON-1518461658-project Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:06.736529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': 'f9fa6279-bb1f-4dca-b762-cde8a7310fb2'} Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:39:06.737174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. Sep 13 06:39:06.738322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:06.740975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] Returning 404 to user: Instance f9fa6279-bb1f-4dca-b762-cde8a7310fb2 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:39:06.742111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5a7948f8-b55f-4240-b0c9-a41c00b45b2e tempest-DeleteServersTestJSON-1518461658 tempest-DeleteServersTestJSON-1518461658-project] 10.222.0.17 "GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2" status: 404 len: 111 microversion: 2.1 time: 0.039351 Sep 13 06:39:06.743502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 127/247] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:06 2022] GET /compute/v2.1/servers/f9fa6279-bb1f-4dca-b762-cde8a7310fb2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:39:07.527495 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fb2d037e-8f05-4a6d-ae3f-7e3fdfeca138 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:07.528884 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fb2d037e-8f05-4a6d-ae3f-7e3fdfeca138 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:07.542983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb2d037e-8f05-4a6d-ae3f-7e3fdfeca138 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:07.545159 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb2d037e-8f05-4a6d-ae3f-7e3fdfeca138 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:07.545783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb2d037e-8f05-4a6d-ae3f-7e3fdfeca138 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:07.555597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb2d037e-8f05-4a6d-ae3f-7e3fdfeca138 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:07.556343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb2d037e-8f05-4a6d-ae3f-7e3fdfeca138 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:07.556792 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb2d037e-8f05-4a6d-ae3f-7e3fdfeca138 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:07.667241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f42cc1c5-488b-442f-9864-31c820e39a9c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:07.668021 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f42cc1c5-488b-442f-9864-31c820e39a9c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:07.682144 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f42cc1c5-488b-442f-9864-31c820e39a9c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:07.682745 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f42cc1c5-488b-442f-9864-31c820e39a9c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:07.683060 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f42cc1c5-488b-442f-9864-31c820e39a9c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:07.683792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f42cc1c5-488b-442f-9864-31c820e39a9c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:07.684251 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f42cc1c5-488b-442f-9864-31c820e39a9c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:07.685205 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f42cc1c5-488b-442f-9864-31c820e39a9c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:08.022400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f42cc1c5-488b-442f-9864-31c820e39a9c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:08.036200 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f42cc1c5-488b-442f-9864-31c820e39a9c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.372935 Sep 13 06:39:08.041428 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 128/248] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:07 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:08.430303 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-133f8d1f-9644-4731-bc84-62834769e588 req-b7b12f3f-ab32-492a-b660-4069b74013a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9822cf48-f14b-409a-b601-383e27e08e5c", "tag": "deaa157c-9c61-4691-947c-e1709bbb783e"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:39:08.450058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-133f8d1f-9644-4731-bc84-62834769e588 req-b7b12f3f-ab32-492a-b660-4069b74013a2 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:08.451103 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-133f8d1f-9644-4731-bc84-62834769e588 req-b7b12f3f-ab32-492a-b660-4069b74013a2 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:08.451692 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-133f8d1f-9644-4731-bc84-62834769e588 req-b7b12f3f-ab32-492a-b660-4069b74013a2 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:08.454582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fb2d037e-8f05-4a6d-ae3f-7e3fdfeca138 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:08.464502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fb2d037e-8f05-4a6d-ae3f-7e3fdfeca138 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.940825 Sep 13 06:39:08.476090 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 121/249] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:07 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:08.486163 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-133f8d1f-9644-4731-bc84-62834769e588 req-b7b12f3f-ab32-492a-b660-4069b74013a2 service nova] Creating event network-changed:deaa157c-9c61-4691-947c-e1709bbb783e for instance 9822cf48-f14b-409a-b601-383e27e08e5c on hv-cinder-85638 Sep 13 06:39:08.499827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-133f8d1f-9644-4731-bc84-62834769e588 req-b7b12f3f-ab32-492a-b660-4069b74013a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071154 Sep 13 06:39:08.501059 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 129/250] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:39:09.062348 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-51751a0e-b9ae-4b5f-bb07-e64d98bb795c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:09.062813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-51751a0e-b9ae-4b5f-bb07-e64d98bb795c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:09.072861 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-51751a0e-b9ae-4b5f-bb07-e64d98bb795c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:09.073356 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-51751a0e-b9ae-4b5f-bb07-e64d98bb795c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:09.079865 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-51751a0e-b9ae-4b5f-bb07-e64d98bb795c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:09.080692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-51751a0e-b9ae-4b5f-bb07-e64d98bb795c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:09.081279 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-51751a0e-b9ae-4b5f-bb07-e64d98bb795c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:09.081737 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-51751a0e-b9ae-4b5f-bb07-e64d98bb795c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:09.471320 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-51751a0e-b9ae-4b5f-bb07-e64d98bb795c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:09.485279 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-51751a0e-b9ae-4b5f-bb07-e64d98bb795c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.428174 Sep 13 06:39:09.501528 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-91c64d10-dc33-4cb4-965b-72695e8b636a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:09.502557 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-91c64d10-dc33-4cb4-965b-72695e8b636a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:09.503546 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 122/251] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:09 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:09.514967 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91c64d10-dc33-4cb4-965b-72695e8b636a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:09.515511 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91c64d10-dc33-4cb4-965b-72695e8b636a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:09.515953 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91c64d10-dc33-4cb4-965b-72695e8b636a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:09.517290 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91c64d10-dc33-4cb4-965b-72695e8b636a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:09.517919 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91c64d10-dc33-4cb4-965b-72695e8b636a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:09.518494 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91c64d10-dc33-4cb4-965b-72695e8b636a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:09.730148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-91c64d10-dc33-4cb4-965b-72695e8b636a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:09.745149 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-91c64d10-dc33-4cb4-965b-72695e8b636a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.248702 Sep 13 06:39:09.747533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 130/252] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:09 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:10.511972 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-539f8aba-389b-49a2-a10f-31530b16970f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:10.512812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-539f8aba-389b-49a2-a10f-31530b16970f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:10.533288 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-539f8aba-389b-49a2-a10f-31530b16970f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:10.533793 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-539f8aba-389b-49a2-a10f-31530b16970f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:10.534382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-539f8aba-389b-49a2-a10f-31530b16970f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:10.535274 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-539f8aba-389b-49a2-a10f-31530b16970f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:10.537997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-539f8aba-389b-49a2-a10f-31530b16970f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:10.538446 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-539f8aba-389b-49a2-a10f-31530b16970f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:10.778244 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7a7d125c-5fd7-4076-84d6-c126a9000a75 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:10.779103 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7a7d125c-5fd7-4076-84d6-c126a9000a75 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:10.792784 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a7d125c-5fd7-4076-84d6-c126a9000a75 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:10.794364 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a7d125c-5fd7-4076-84d6-c126a9000a75 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:10.795005 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a7d125c-5fd7-4076-84d6-c126a9000a75 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:10.795942 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a7d125c-5fd7-4076-84d6-c126a9000a75 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:10.797161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a7d125c-5fd7-4076-84d6-c126a9000a75 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:10.797795 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a7d125c-5fd7-4076-84d6-c126a9000a75 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:11.113735 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-539f8aba-389b-49a2-a10f-31530b16970f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:11.124582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-539f8aba-389b-49a2-a10f-31530b16970f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.616795 Sep 13 06:39:11.127755 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 123/253] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:10 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:11.145892 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7a7d125c-5fd7-4076-84d6-c126a9000a75 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:11.156165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7a7d125c-5fd7-4076-84d6-c126a9000a75 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.391054 Sep 13 06:39:11.158482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 131/254] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:10 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:12.147084 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-44bdc165-f5fd-4ae4-92d7-b08d616f9031 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:12.147722 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-44bdc165-f5fd-4ae4-92d7-b08d616f9031 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:12.181305 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e526d81c-6168-4d5f-85e0-e6fa4b68eca0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:12.181918 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e526d81c-6168-4d5f-85e0-e6fa4b68eca0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:12.189013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44bdc165-f5fd-4ae4-92d7-b08d616f9031 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:12.190320 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e526d81c-6168-4d5f-85e0-e6fa4b68eca0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:12.194968 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44bdc165-f5fd-4ae4-92d7-b08d616f9031 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:12.195658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44bdc165-f5fd-4ae4-92d7-b08d616f9031 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:12.196652 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44bdc165-f5fd-4ae4-92d7-b08d616f9031 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:12.198663 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44bdc165-f5fd-4ae4-92d7-b08d616f9031 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:12.199128 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44bdc165-f5fd-4ae4-92d7-b08d616f9031 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:12.202211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e526d81c-6168-4d5f-85e0-e6fa4b68eca0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:12.202911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e526d81c-6168-4d5f-85e0-e6fa4b68eca0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:12.204009 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e526d81c-6168-4d5f-85e0-e6fa4b68eca0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:12.207880 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e526d81c-6168-4d5f-85e0-e6fa4b68eca0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:12.208736 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e526d81c-6168-4d5f-85e0-e6fa4b68eca0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:12.436217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e526d81c-6168-4d5f-85e0-e6fa4b68eca0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:12.444751 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e526d81c-6168-4d5f-85e0-e6fa4b68eca0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.267249 Sep 13 06:39:12.445450 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 132/255] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:12 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:12.817789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-44bdc165-f5fd-4ae4-92d7-b08d616f9031 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:12.827928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-44bdc165-f5fd-4ae4-92d7-b08d616f9031 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.684467 Sep 13 06:39:12.828672 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 124/256] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:12 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:13.468392 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-49b7b5db-39d6-40fd-891d-9cc39b3b7476 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:13.468994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-49b7b5db-39d6-40fd-891d-9cc39b3b7476 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:13.474937 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49b7b5db-39d6-40fd-891d-9cc39b3b7476 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:13.475625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49b7b5db-39d6-40fd-891d-9cc39b3b7476 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:13.476187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49b7b5db-39d6-40fd-891d-9cc39b3b7476 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:13.477012 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49b7b5db-39d6-40fd-891d-9cc39b3b7476 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:13.477592 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49b7b5db-39d6-40fd-891d-9cc39b3b7476 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:13.478333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49b7b5db-39d6-40fd-891d-9cc39b3b7476 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:13.822311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:13.827273 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-49b7b5db-39d6-40fd-891d-9cc39b3b7476 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:13.839593 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-49b7b5db-39d6-40fd-891d-9cc39b3b7476 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.374790 Sep 13 06:39:13.849386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=6 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:13.856350 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 133/257] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:13 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:13.865076 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-07c9349c-9df6-40f6-855c-e7350e6ad07c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:13.865820 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-07c9349c-9df6-40f6-855c-e7350e6ad07c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:13.873138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07c9349c-9df6-40f6-855c-e7350e6ad07c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:13.873943 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07c9349c-9df6-40f6-855c-e7350e6ad07c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:13.874984 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07c9349c-9df6-40f6-855c-e7350e6ad07c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:13.876197 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07c9349c-9df6-40f6-855c-e7350e6ad07c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:13.876874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07c9349c-9df6-40f6-855c-e7350e6ad07c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:13.877516 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07c9349c-9df6-40f6-855c-e7350e6ad07c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:14.080102 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4f35f6a4-236a-4c13-8738-cf3326024409 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Action: 'create', calling method: .version_select at 0x7fdc0d7bc3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-621610664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApgip+xbH7SrnNstO396TKq+RyUTdE35wQF4D14w01A8z3YK6OYYQeB7+024zu98j6t5Q3CRNsLhcNcZyzg94EbWv8h4gPHvBIwNnIRcJwMu7S/4ZSkXhwNZTgThG2WkQ=="}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:39:14.096055 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-4f35f6a4-236a-4c13-8738-cf3326024409 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Getting quotas for project 5d92a2cc741d45aba5ac112718389c22. Resources: {'key_pairs'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:39:14.100041 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-4f35f6a4-236a-4c13-8738-cf3326024409 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Getting quotas for user ca7cb5590aff4b0283cd583b391a5ffe and project 5d92a2cc741d45aba5ac112718389c22. Resources: {'key_pairs'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:39:14.123600 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4f35f6a4-236a-4c13-8738-cf3326024409 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.365180 Sep 13 06:39:14.130327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 125/258] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Sep 13 06:39:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:39:14.151559 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:14.214242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-07c9349c-9df6-40f6-855c-e7350e6ad07c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:14.223178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-07c9349c-9df6-40f6-855c-e7350e6ad07c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.363423 Sep 13 06:39:14.229744 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 134/259] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:13 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:14.870335 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-cb9a62b1-f26f-43fa-af2b-340ceb88b6d0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:14.870886 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-cb9a62b1-f26f-43fa-af2b-340ceb88b6d0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:14.879987 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb9a62b1-f26f-43fa-af2b-340ceb88b6d0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:14.880640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb9a62b1-f26f-43fa-af2b-340ceb88b6d0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:14.881276 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb9a62b1-f26f-43fa-af2b-340ceb88b6d0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:14.882146 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb9a62b1-f26f-43fa-af2b-340ceb88b6d0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:14.882749 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb9a62b1-f26f-43fa-af2b-340ceb88b6d0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:14.883327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb9a62b1-f26f-43fa-af2b-340ceb88b6d0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:15.076621 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-cb9a62b1-f26f-43fa-af2b-340ceb88b6d0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:15.085097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-cb9a62b1-f26f-43fa-af2b-340ceb88b6d0 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.221319 Sep 13 06:39:15.085674 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 126/260] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:14 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:15.255387 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2b986426-5548-4d08-b5ee-9794c14683c2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:15.256635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2b986426-5548-4d08-b5ee-9794c14683c2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:15.269769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2b986426-5548-4d08-b5ee-9794c14683c2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:15.276623 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2b986426-5548-4d08-b5ee-9794c14683c2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:15.278109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2b986426-5548-4d08-b5ee-9794c14683c2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:15.282704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2b986426-5548-4d08-b5ee-9794c14683c2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:15.283307 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2b986426-5548-4d08-b5ee-9794c14683c2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:15.285611 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2b986426-5548-4d08-b5ee-9794c14683c2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:15.530927 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2b986426-5548-4d08-b5ee-9794c14683c2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:15.539065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2b986426-5548-4d08-b5ee-9794c14683c2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.288502 Sep 13 06:39:15.540043 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 135/261] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:15 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:16.090825 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-95ab0ef7-029f-4a77-91ba-bd4a96c2dcfc tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] Action: 'create', calling method: .version_select at 0x7fdc0d65bee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-560517042", "metadata": {"Type": "work"}}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:39:16.110472 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-51fd6ad4-1a64-4f99-8263-225b89720364 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:16.111091 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-51fd6ad4-1a64-4f99-8263-225b89720364 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:16.119389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51fd6ad4-1a64-4f99-8263-225b89720364 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:16.120317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51fd6ad4-1a64-4f99-8263-225b89720364 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:16.120900 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51fd6ad4-1a64-4f99-8263-225b89720364 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:16.121600 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51fd6ad4-1a64-4f99-8263-225b89720364 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:16.122584 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51fd6ad4-1a64-4f99-8263-225b89720364 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:16.122999 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51fd6ad4-1a64-4f99-8263-225b89720364 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:16.298594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-51fd6ad4-1a64-4f99-8263-225b89720364 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:16.313738 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-51fd6ad4-1a64-4f99-8263-225b89720364 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.208491 Sep 13 06:39:16.314607 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 136/262] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:16 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:16.563856 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2e9a429a-652c-4ddb-a401-cfc09e05f548 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:16.564622 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2e9a429a-652c-4ddb-a401-cfc09e05f548 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:16.572577 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e9a429a-652c-4ddb-a401-cfc09e05f548 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:16.573360 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e9a429a-652c-4ddb-a401-cfc09e05f548 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:16.574001 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e9a429a-652c-4ddb-a401-cfc09e05f548 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:16.574865 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e9a429a-652c-4ddb-a401-cfc09e05f548 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:16.575740 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e9a429a-652c-4ddb-a401-cfc09e05f548 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:16.576317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e9a429a-652c-4ddb-a401-cfc09e05f548 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:16.606088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:16.615756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-95ab0ef7-029f-4a77-91ba-bd4a96c2dcfc tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.726614 Sep 13 06:39:16.616720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 127/263] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Sep 13 06:39:15 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 728 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 06:39:16.631264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8e1bc058-19d7-48ab-9a3f-e73361bcf6c1 tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] Calling method '.version_select at 0x7fdc0d67e8b0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:16.714524 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8e1bc058-19d7-48ab-9a3f-e73361bcf6c1 tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40" status: 200 len: 352 microversion: 2.1 time: 0.087613 Sep 13 06:39:16.716226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 128/264] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:39:16 2022] GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40 => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:39:16.789481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2e9a429a-652c-4ddb-a401-cfc09e05f548 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:16.799895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2e9a429a-652c-4ddb-a401-cfc09e05f548 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.241510 Sep 13 06:39:16.800477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 137/265] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:16 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:17.338536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-acbd7673-4df2-466c-b8fe-a671c7bb6ee5 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:17.340071 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-acbd7673-4df2-466c-b8fe-a671c7bb6ee5 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:17.347985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-acbd7673-4df2-466c-b8fe-a671c7bb6ee5 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:17.348624 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-acbd7673-4df2-466c-b8fe-a671c7bb6ee5 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:17.348850 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-acbd7673-4df2-466c-b8fe-a671c7bb6ee5 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:17.349484 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-acbd7673-4df2-466c-b8fe-a671c7bb6ee5 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:17.350094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-acbd7673-4df2-466c-b8fe-a671c7bb6ee5 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:17.350516 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-acbd7673-4df2-466c-b8fe-a671c7bb6ee5 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:17.494400 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-acbd7673-4df2-466c-b8fe-a671c7bb6ee5 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:17.502510 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-acbd7673-4df2-466c-b8fe-a671c7bb6ee5 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.168371 Sep 13 06:39:17.503101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 129/266] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:17 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:17.731259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e0ca6c32-bb01-4521-a388-6fa1a45dd3ba tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] Calling method '.version_select at 0x7fdc0d6dbb80>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:17.778132 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e0ca6c32-bb01-4521-a388-6fa1a45dd3ba tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40" status: 200 len: 352 microversion: 2.1 time: 0.050603 Sep 13 06:39:17.778696 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 138/267] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:39:17 2022] GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:39:17.824526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-cdbcd4a6-c62d-4c0e-a954-782b66e10a52 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:17.825165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-cdbcd4a6-c62d-4c0e-a954-782b66e10a52 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:17.831139 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cdbcd4a6-c62d-4c0e-a954-782b66e10a52 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:17.831662 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cdbcd4a6-c62d-4c0e-a954-782b66e10a52 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:17.832097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cdbcd4a6-c62d-4c0e-a954-782b66e10a52 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:17.832787 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cdbcd4a6-c62d-4c0e-a954-782b66e10a52 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:17.833270 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cdbcd4a6-c62d-4c0e-a954-782b66e10a52 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:17.833691 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cdbcd4a6-c62d-4c0e-a954-782b66e10a52 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:17.977075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-cdbcd4a6-c62d-4c0e-a954-782b66e10a52 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:17.987331 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-cdbcd4a6-c62d-4c0e-a954-782b66e10a52 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1521 microversion: 2.1 time: 0.166395 Sep 13 06:39:17.999040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 130/268] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:17 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:18.525834 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ee582511-0437-4070-aa88-02196153f526 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:18.526348 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ee582511-0437-4070-aa88-02196153f526 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:18.532406 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee582511-0437-4070-aa88-02196153f526 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:18.532886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee582511-0437-4070-aa88-02196153f526 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:18.533318 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee582511-0437-4070-aa88-02196153f526 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:18.534004 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee582511-0437-4070-aa88-02196153f526 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:18.534453 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee582511-0437-4070-aa88-02196153f526 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:18.534876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee582511-0437-4070-aa88-02196153f526 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:18.675173 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ee582511-0437-4070-aa88-02196153f526 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:18.682760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ee582511-0437-4070-aa88-02196153f526 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.160987 Sep 13 06:39:18.683330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 139/269] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:18 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:18.792355 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f3360df0-2c05-4782-b06a-1ad11313f0d2 tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] Calling method '.version_select at 0x7fdc0d67e280>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:18.855106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f3360df0-2c05-4782-b06a-1ad11313f0d2 tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40" status: 200 len: 353 microversion: 2.1 time: 0.066722 Sep 13 06:39:18.855793 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 131/270] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:39:18 2022] GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:39:18.869233 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ab068c9a-faf6-46ca-977c-f29cd46baa56 tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] Calling method '.version_select at 0x7fdc0d6d25e0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:18.939316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ab068c9a-faf6-46ca-977c-f29cd46baa56 tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40" status: 200 len: 353 microversion: 2.1 time: 0.073960 Sep 13 06:39:18.940546 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 140/271] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:39:18 2022] GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:39:18.957588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d1dafe51-1ede-4d6d-84e6-3126492dd02a tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] Calling method '.version_select at 0x7fdc0d65b700>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:18.968502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-de45a6c9-fea1-4e29-8166-b053752d532d req-efd5ff1c-02b6-4846-a8dc-a4df3863e197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9822cf48-f14b-409a-b601-383e27e08e5c", "name": "network-vif-plugged", "status": "completed", "tag": "deaa157c-9c61-4691-947c-e1709bbb783e"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:39:18.981825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-de45a6c9-fea1-4e29-8166-b053752d532d req-efd5ff1c-02b6-4846-a8dc-a4df3863e197 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:18.982602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-de45a6c9-fea1-4e29-8166-b053752d532d req-efd5ff1c-02b6-4846-a8dc-a4df3863e197 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:18.983600 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-de45a6c9-fea1-4e29-8166-b053752d532d req-efd5ff1c-02b6-4846-a8dc-a4df3863e197 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:19.009949 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-de45a6c9-fea1-4e29-8166-b053752d532d req-efd5ff1c-02b6-4846-a8dc-a4df3863e197 service nova] Creating event network-vif-plugged:deaa157c-9c61-4691-947c-e1709bbb783e for instance 9822cf48-f14b-409a-b601-383e27e08e5c on hv-cinder-85638 Sep 13 06:39:19.017351 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-de45a6c9-fea1-4e29-8166-b053752d532d req-efd5ff1c-02b6-4846-a8dc-a4df3863e197 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056355 Sep 13 06:39:19.018462 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 141/272] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:39:19.032118 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ef4ab879-8d37-4a9f-9e6f-5af9620a3f08 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:19.032928 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ef4ab879-8d37-4a9f-9e6f-5af9620a3f08 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:19.048199 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef4ab879-8d37-4a9f-9e6f-5af9620a3f08 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:19.049186 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef4ab879-8d37-4a9f-9e6f-5af9620a3f08 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:19.050189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef4ab879-8d37-4a9f-9e6f-5af9620a3f08 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:19.050492 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d1dafe51-1ede-4d6d-84e6-3126492dd02a tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40" status: 202 len: 0 microversion: 2.1 time: 0.096371 Sep 13 06:39:19.051158 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef4ab879-8d37-4a9f-9e6f-5af9620a3f08 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:19.051570 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 132/273] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Sep 13 06:39:18 2022] DELETE /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:39:19.051985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef4ab879-8d37-4a9f-9e6f-5af9620a3f08 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:19.052923 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef4ab879-8d37-4a9f-9e6f-5af9620a3f08 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:19.059909 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-14f444c9-2e0d-44dc-b415-317e9c45135e tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] Calling method '.version_select at 0x7fdc0d7bc040>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:19.156381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-14f444c9-2e0d-44dc-b415-317e9c45135e tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40" status: 200 len: 352 microversion: 2.1 time: 0.100560 Sep 13 06:39:19.157635 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 133/274] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:39:19 2022] GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:39:19.290858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ef4ab879-8d37-4a9f-9e6f-5af9620a3f08 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:19.302139 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ef4ab879-8d37-4a9f-9e6f-5af9620a3f08 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1501 microversion: 2.1 time: 0.280215 Sep 13 06:39:19.302811 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 142/275] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:19 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1501 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:19.326581 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-159a93aa-5aa3-4b6a-a41e-df2c2253a987 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:19.327314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-159a93aa-5aa3-4b6a-a41e-df2c2253a987 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:19.334583 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-159a93aa-5aa3-4b6a-a41e-df2c2253a987 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:19.335257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-159a93aa-5aa3-4b6a-a41e-df2c2253a987 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:19.335830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-159a93aa-5aa3-4b6a-a41e-df2c2253a987 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:19.336768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-159a93aa-5aa3-4b6a-a41e-df2c2253a987 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:19.337413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-159a93aa-5aa3-4b6a-a41e-df2c2253a987 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:19.337932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-159a93aa-5aa3-4b6a-a41e-df2c2253a987 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:19.498350 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-159a93aa-5aa3-4b6a-a41e-df2c2253a987 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:19.506006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-159a93aa-5aa3-4b6a-a41e-df2c2253a987 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1515 microversion: 2.1 time: 0.184121 Sep 13 06:39:19.506571 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 134/276] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:19 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:19.707183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e3a1f01f-0052-4e83-94f3-fb345a9581ca tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:19.707913 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e3a1f01f-0052-4e83-94f3-fb345a9581ca tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:19.714130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3a1f01f-0052-4e83-94f3-fb345a9581ca tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:19.714606 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3a1f01f-0052-4e83-94f3-fb345a9581ca tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:19.715027 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3a1f01f-0052-4e83-94f3-fb345a9581ca tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:19.715762 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3a1f01f-0052-4e83-94f3-fb345a9581ca tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:19.716201 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3a1f01f-0052-4e83-94f3-fb345a9581ca tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:19.716615 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3a1f01f-0052-4e83-94f3-fb345a9581ca tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:19.886470 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e3a1f01f-0052-4e83-94f3-fb345a9581ca tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:19.894850 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e3a1f01f-0052-4e83-94f3-fb345a9581ca tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.192051 Sep 13 06:39:19.895489 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 143/277] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:19 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:20.171682 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-146bd86b-3ed7-4598-8ad3-4a5d1837454f tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] Calling method '.version_select at 0x7fdc0d67e3a0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:20.199984 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-146bd86b-3ed7-4598-8ad3-4a5d1837454f tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] HTTP exception thrown: Volume 4f9eefb8-d258-4420-a28c-34a8b4694e40 could not be found. Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-146bd86b-3ed7-4598-8ad3-4a5d1837454f tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] Request method failure captured: Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40 HTTP/1.1 Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICWTuEk7EX1RPe-2w6RfFnUfsY1ep2a8AIC0pgW-BBfBdGkLbi1oHsFnCP5gYWtwzM69eJS_T7FUOetuYuE7c44KfBT3Me9UsZINyXxE50OAm9QYaaWZzt6I366-vnDfuALX4BGy8D5Q9JPh83NpWM_2ExWe2U35EgBoY6SinQlDTGo Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 8a8bc4ffc8234f71b552fd329644bb79 Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesGetTestJSON-2062573774 Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:39:20.201928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8a8bc4ffc8234f71b552fd329644bb79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a8bc4ffc8234f71b552fd329644bb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8a8bc4ffc8234f71b552fd329644bb79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8a8bc4ffc8234f71b552fd329644bb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesGetTestJSON-2062573774 Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 8a8bc4ffc8234f71b552fd329644bb79 Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesGetTestJSON-2062573774 Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesGetTestJSON-2062573774-project Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 467ae4a962f24421888c7bfc88690f7d Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesGetTestJSON-2062573774-project Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Volume 4f9eefb8-d258-4420-a28c-34a8b4694e40 could not be found. Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '4f9eefb8-d258-4420-a28c-34a8b4694e40'} Sep 13 06:39:20.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f9eefb8-d258-4420-a28c-34a8b4694e40 could not be found. (HTTP 404) (Request-ID: req-67cf1d81-57a1-491b-9577-955d87cc2233) Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:20.204362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 06:39:20.205488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f9eefb8-d258-4420-a28c-34a8b4694e40 could not be found. Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 06:39:20.206588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f9eefb8-d258-4420-a28c-34a8b4694e40 could not be found. Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f9eefb8-d258-4420-a28c-34a8b4694e40 could not be found. Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-146bd86b-3ed7-4598-8ad3-4a5d1837454f tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] Returning 404 to user: Volume 4f9eefb8-d258-4420-a28c-34a8b4694e40 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-146bd86b-3ed7-4598-8ad3-4a5d1837454f tempest-VolumesGetTestJSON-2062573774 tempest-VolumesGetTestJSON-2062573774-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40" status: 404 len: 109 microversion: 2.1 time: 0.036122 Sep 13 06:39:20.207801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 135/278] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:39:20 2022] GET /compute/v2.1/os-volumes/4f9eefb8-d258-4420-a28c-34a8b4694e40 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:39:20.917873 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-922f55be-1d79-4f15-8eaa-81133ec46a91 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:20.919899 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-922f55be-1d79-4f15-8eaa-81133ec46a91 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:20.933240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-922f55be-1d79-4f15-8eaa-81133ec46a91 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:20.933877 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-922f55be-1d79-4f15-8eaa-81133ec46a91 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:20.934616 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-922f55be-1d79-4f15-8eaa-81133ec46a91 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:20.935315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-922f55be-1d79-4f15-8eaa-81133ec46a91 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:20.935792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-922f55be-1d79-4f15-8eaa-81133ec46a91 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:20.936213 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-922f55be-1d79-4f15-8eaa-81133ec46a91 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:21.081718 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-922f55be-1d79-4f15-8eaa-81133ec46a91 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:21.089389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-922f55be-1d79-4f15-8eaa-81133ec46a91 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.176130 Sep 13 06:39:21.089960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 144/279] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:20 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:22.113654 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f6a5b62a-bf91-4f3e-9a40-377e48a0e479 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:22.114359 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f6a5b62a-bf91-4f3e-9a40-377e48a0e479 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:22.125065 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6a5b62a-bf91-4f3e-9a40-377e48a0e479 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:22.125658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6a5b62a-bf91-4f3e-9a40-377e48a0e479 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:22.126337 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6a5b62a-bf91-4f3e-9a40-377e48a0e479 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:22.127303 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6a5b62a-bf91-4f3e-9a40-377e48a0e479 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:22.127851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6a5b62a-bf91-4f3e-9a40-377e48a0e479 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:22.128282 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f6a5b62a-bf91-4f3e-9a40-377e48a0e479 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:22.267653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f6a5b62a-bf91-4f3e-9a40-377e48a0e479 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:22.275591 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f6a5b62a-bf91-4f3e-9a40-377e48a0e479 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.167001 Sep 13 06:39:22.276235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 136/280] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:22 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:23.301079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4f360f08-fe1f-4131-910b-0c246f3938b7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:23.302357 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4f360f08-fe1f-4131-910b-0c246f3938b7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:23.308323 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4f360f08-fe1f-4131-910b-0c246f3938b7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:23.308801 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4f360f08-fe1f-4131-910b-0c246f3938b7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:23.309590 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4f360f08-fe1f-4131-910b-0c246f3938b7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:23.310298 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4f360f08-fe1f-4131-910b-0c246f3938b7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:23.310756 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4f360f08-fe1f-4131-910b-0c246f3938b7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:23.311176 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4f360f08-fe1f-4131-910b-0c246f3938b7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:23.448817 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4f360f08-fe1f-4131-910b-0c246f3938b7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:23.457072 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4f360f08-fe1f-4131-910b-0c246f3938b7 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.160556 Sep 13 06:39:23.457635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 145/281] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:23 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:24.480725 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8ea3a89f-b4b1-41af-b6b6-153a923a5f3b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:24.482090 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8ea3a89f-b4b1-41af-b6b6-153a923a5f3b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:24.484569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=4 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:24.489881 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ea3a89f-b4b1-41af-b6b6-153a923a5f3b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:24.490452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ea3a89f-b4b1-41af-b6b6-153a923a5f3b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:24.490959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ea3a89f-b4b1-41af-b6b6-153a923a5f3b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:24.491697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ea3a89f-b4b1-41af-b6b6-153a923a5f3b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:24.492157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ea3a89f-b4b1-41af-b6b6-153a923a5f3b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:24.492582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ea3a89f-b4b1-41af-b6b6-153a923a5f3b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:24.650073 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8ea3a89f-b4b1-41af-b6b6-153a923a5f3b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:24.658938 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8ea3a89f-b4b1-41af-b6b6-153a923a5f3b tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.182047 Sep 13 06:39:24.659532 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 137/282] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:24 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:25.681878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d952a2a0-65c0-498c-b258-96ffdb66373a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:25.682492 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d952a2a0-65c0-498c-b258-96ffdb66373a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:25.685107 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:25.690365 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d952a2a0-65c0-498c-b258-96ffdb66373a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:25.690844 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d952a2a0-65c0-498c-b258-96ffdb66373a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:25.691276 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d952a2a0-65c0-498c-b258-96ffdb66373a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:25.691989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d952a2a0-65c0-498c-b258-96ffdb66373a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:25.692443 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d952a2a0-65c0-498c-b258-96ffdb66373a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:25.692863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d952a2a0-65c0-498c-b258-96ffdb66373a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:25.819936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d952a2a0-65c0-498c-b258-96ffdb66373a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:25.829090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d952a2a0-65c0-498c-b258-96ffdb66373a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.150951 Sep 13 06:39:25.829660 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 146/283] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:25 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:26.851433 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e68b03ae-2c0a-4cf8-934a-ee058d84056f tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:26.851996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e68b03ae-2c0a-4cf8-934a-ee058d84056f tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:26.858327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e68b03ae-2c0a-4cf8-934a-ee058d84056f tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:26.858828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e68b03ae-2c0a-4cf8-934a-ee058d84056f tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:26.859261 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e68b03ae-2c0a-4cf8-934a-ee058d84056f tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:26.859974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e68b03ae-2c0a-4cf8-934a-ee058d84056f tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:26.860431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e68b03ae-2c0a-4cf8-934a-ee058d84056f tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:26.860854 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e68b03ae-2c0a-4cf8-934a-ee058d84056f tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:26.984688 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e68b03ae-2c0a-4cf8-934a-ee058d84056f tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:26.986872 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:26.993568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e68b03ae-2c0a-4cf8-934a-ee058d84056f tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.146046 Sep 13 06:39:26.994136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 138/284] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:26 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:28.015196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1f006e40-508f-4301-b907-4df3c0eace4d tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:28.015759 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1f006e40-508f-4301-b907-4df3c0eace4d tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:28.021608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1f006e40-508f-4301-b907-4df3c0eace4d tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:28.022084 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1f006e40-508f-4301-b907-4df3c0eace4d tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:28.022516 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1f006e40-508f-4301-b907-4df3c0eace4d tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:28.023199 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1f006e40-508f-4301-b907-4df3c0eace4d tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:28.023674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1f006e40-508f-4301-b907-4df3c0eace4d tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:28.024091 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1f006e40-508f-4301-b907-4df3c0eace4d tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:28.155653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1f006e40-508f-4301-b907-4df3c0eace4d tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:28.163438 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1f006e40-508f-4301-b907-4df3c0eace4d tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.152089 Sep 13 06:39:28.163994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 147/285] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:28 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:29.186728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2ead7499-ca89-4ac0-bb1a-3b89539cb402 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:29.187336 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2ead7499-ca89-4ac0-bb1a-3b89539cb402 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:29.193697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ead7499-ca89-4ac0-bb1a-3b89539cb402 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:29.194179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ead7499-ca89-4ac0-bb1a-3b89539cb402 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:29.194613 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ead7499-ca89-4ac0-bb1a-3b89539cb402 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:29.195305 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ead7499-ca89-4ac0-bb1a-3b89539cb402 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:29.195787 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ead7499-ca89-4ac0-bb1a-3b89539cb402 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:29.196208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ead7499-ca89-4ac0-bb1a-3b89539cb402 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:29.325170 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2ead7499-ca89-4ac0-bb1a-3b89539cb402 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:29.333040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2ead7499-ca89-4ac0-bb1a-3b89539cb402 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.150993 Sep 13 06:39:29.333606 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 139/286] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:29 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:30.355271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-92685fec-857e-436f-9a1e-98c91bd000f9 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:30.355900 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-92685fec-857e-436f-9a1e-98c91bd000f9 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:30.361853 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-92685fec-857e-436f-9a1e-98c91bd000f9 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:30.362311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-92685fec-857e-436f-9a1e-98c91bd000f9 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:30.362738 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-92685fec-857e-436f-9a1e-98c91bd000f9 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:30.363440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-92685fec-857e-436f-9a1e-98c91bd000f9 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:30.363888 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-92685fec-857e-436f-9a1e-98c91bd000f9 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:30.364305 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-92685fec-857e-436f-9a1e-98c91bd000f9 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:30.491225 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-92685fec-857e-436f-9a1e-98c91bd000f9 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:30.499164 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-92685fec-857e-436f-9a1e-98c91bd000f9 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1315 microversion: 2.1 time: 0.147866 Sep 13 06:39:30.499744 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 148/287] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:30 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:31.522722 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7293422c-0791-4060-aea7-5c9e7f090713 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:31.523334 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7293422c-0791-4060-aea7-5c9e7f090713 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:31.525603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:31.531499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7293422c-0791-4060-aea7-5c9e7f090713 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:31.531987 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7293422c-0791-4060-aea7-5c9e7f090713 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:31.532426 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7293422c-0791-4060-aea7-5c9e7f090713 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:31.533120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7293422c-0791-4060-aea7-5c9e7f090713 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:31.533575 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7293422c-0791-4060-aea7-5c9e7f090713 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:31.533999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7293422c-0791-4060-aea7-5c9e7f090713 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:31.665805 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7293422c-0791-4060-aea7-5c9e7f090713 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:31.673730 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7293422c-0791-4060-aea7-5c9e7f090713 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1465 microversion: 2.1 time: 0.155240 Sep 13 06:39:31.674314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 140/288] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:31 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:31.720896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-dca5cf7f-a3cd-46bc-989b-055776355dcb tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:31.721444 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-dca5cf7f-a3cd-46bc-989b-055776355dcb tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:31.727254 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dca5cf7f-a3cd-46bc-989b-055776355dcb tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:31.727760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dca5cf7f-a3cd-46bc-989b-055776355dcb tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:31.728185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dca5cf7f-a3cd-46bc-989b-055776355dcb tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:31.729496 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dca5cf7f-a3cd-46bc-989b-055776355dcb tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:31.729950 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dca5cf7f-a3cd-46bc-989b-055776355dcb tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:31.730374 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dca5cf7f-a3cd-46bc-989b-055776355dcb tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:31.758317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-dca5cf7f-a3cd-46bc-989b-055776355dcb tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:39:31.853230 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-dca5cf7f-a3cd-46bc-989b-055776355dcb tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 204 len: 0 microversion: 2.1 time: 0.135826 Sep 13 06:39:31.854185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 149/289] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:39:31 2022] DELETE /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:39:31.862045 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c501161e-0a11-4907-afe9-7a3c19332719 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:31.862654 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c501161e-0a11-4907-afe9-7a3c19332719 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:31.869580 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c501161e-0a11-4907-afe9-7a3c19332719 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:31.870077 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c501161e-0a11-4907-afe9-7a3c19332719 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:31.870514 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c501161e-0a11-4907-afe9-7a3c19332719 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:31.871201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c501161e-0a11-4907-afe9-7a3c19332719 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:31.872213 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c501161e-0a11-4907-afe9-7a3c19332719 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:31.872633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c501161e-0a11-4907-afe9-7a3c19332719 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:32.013901 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c501161e-0a11-4907-afe9-7a3c19332719 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:32.021782 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c501161e-0a11-4907-afe9-7a3c19332719 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1471 microversion: 2.1 time: 0.163555 Sep 13 06:39:32.022356 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 141/290] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:31 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:33.044643 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-baa67a88-58e1-489c-9983-2fe66330f588 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:33.045364 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-baa67a88-58e1-489c-9983-2fe66330f588 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:33.051480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-baa67a88-58e1-489c-9983-2fe66330f588 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:33.052748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-baa67a88-58e1-489c-9983-2fe66330f588 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:33.052748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-baa67a88-58e1-489c-9983-2fe66330f588 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:33.053418 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-baa67a88-58e1-489c-9983-2fe66330f588 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:33.053932 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-baa67a88-58e1-489c-9983-2fe66330f588 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:33.054433 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-baa67a88-58e1-489c-9983-2fe66330f588 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:33.186447 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-baa67a88-58e1-489c-9983-2fe66330f588 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:33.193989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-baa67a88-58e1-489c-9983-2fe66330f588 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1471 microversion: 2.1 time: 0.153618 Sep 13 06:39:33.194544 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 150/291] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:33 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:34.217363 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-69f73c2a-0e61-4d36-9080-07476fa20d6a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:34.217977 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-69f73c2a-0e61-4d36-9080-07476fa20d6a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:34.224349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69f73c2a-0e61-4d36-9080-07476fa20d6a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:34.224830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69f73c2a-0e61-4d36-9080-07476fa20d6a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:34.225265 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69f73c2a-0e61-4d36-9080-07476fa20d6a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:34.225948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69f73c2a-0e61-4d36-9080-07476fa20d6a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:34.226408 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69f73c2a-0e61-4d36-9080-07476fa20d6a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:34.226830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69f73c2a-0e61-4d36-9080-07476fa20d6a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:34.367563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-69f73c2a-0e61-4d36-9080-07476fa20d6a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:34.375131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-69f73c2a-0e61-4d36-9080-07476fa20d6a tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1471 microversion: 2.1 time: 0.162057 Sep 13 06:39:34.375724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 142/292] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:34 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:35.389531 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-a737ee26-919a-4580-bf93-a39f97ad284c req-a8a84ff4-e1fc-4e8c-b255-5e4e06ad7300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9822cf48-f14b-409a-b601-383e27e08e5c", "name": "network-vif-deleted", "tag": "deaa157c-9c61-4691-947c-e1709bbb783e"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:39:35.399316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-a737ee26-919a-4580-bf93-a39f97ad284c req-a8a84ff4-e1fc-4e8c-b255-5e4e06ad7300 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:35.399830 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-a737ee26-919a-4580-bf93-a39f97ad284c req-a8a84ff4-e1fc-4e8c-b255-5e4e06ad7300 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:35.400532 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-23b0a7c7-4694-46ed-bfd7-c5f017acc279 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:35.401016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-a737ee26-919a-4580-bf93-a39f97ad284c req-a8a84ff4-e1fc-4e8c-b255-5e4e06ad7300 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:35.401118 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-23b0a7c7-4694-46ed-bfd7-c5f017acc279 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:35.408892 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23b0a7c7-4694-46ed-bfd7-c5f017acc279 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:35.409537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23b0a7c7-4694-46ed-bfd7-c5f017acc279 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:35.410080 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23b0a7c7-4694-46ed-bfd7-c5f017acc279 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:35.410996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23b0a7c7-4694-46ed-bfd7-c5f017acc279 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:35.411767 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23b0a7c7-4694-46ed-bfd7-c5f017acc279 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:35.412261 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23b0a7c7-4694-46ed-bfd7-c5f017acc279 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:35.435267 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-a737ee26-919a-4580-bf93-a39f97ad284c req-a8a84ff4-e1fc-4e8c-b255-5e4e06ad7300 service nova] Creating event network-vif-deleted:deaa157c-9c61-4691-947c-e1709bbb783e for instance 9822cf48-f14b-409a-b601-383e27e08e5c on hv-cinder-85638 Sep 13 06:39:35.450431 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-a737ee26-919a-4580-bf93-a39f97ad284c req-a8a84ff4-e1fc-4e8c-b255-5e4e06ad7300 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065576 Sep 13 06:39:35.451136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 151/293] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:39:35.487597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-23b0a7c7-4694-46ed-bfd7-c5f017acc279 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b1c3face934a748d51b6dd2cffec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05975066db346c7a032f273df0744e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:35.497822 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-23b0a7c7-4694-46ed-bfd7-c5f017acc279 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 200 len: 1429 microversion: 2.1 time: 0.102662 Sep 13 06:39:35.503396 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 143/294] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:35 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:36.522025 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:36.522715 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] [instance: 9822cf48-f14b-409a-b601-383e27e08e5c] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:36.528855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:36.529328 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:36.529752 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:36.530426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:36.530873 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:36.531286 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:36.545907 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] HTTP exception thrown: Instance 9822cf48-f14b-409a-b601-383e27e08e5c could not be found. Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Request method failure captured: Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c HTTP/1.1 Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICWFE7NLoWuslrF_rxsjJOFVR3Yo6TkEuKULiKdN7GyCVcag9oEOKsJrT0VQzN5pDUdkuPElGypm4BE3-HP3sYWNHKYBIYElZ-9KvTv6pV_roUAJ_gZOK08UTj9kebC2cavjFXZG562-PLWEzIQbnon2JQkf2fElCEPgqrPfxYRnZYo Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: e05975066db346c7a032f273df0744e1 Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-VolumesNegativeTest-696271780 Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:39:36.547553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e05975066db346c7a032f273df0744e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e05975066db346c7a032f273df0744e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e05975066db346c7a032f273df0744e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e05975066db346c7a032f273df0744e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-VolumesNegativeTest-696271780 Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: e05975066db346c7a032f273df0744e1 Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-VolumesNegativeTest-696271780 Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-VolumesNegativeTest-696271780-project Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 08b1c3face934a748d51b6dd2cffec4b Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-VolumesNegativeTest-696271780-project Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 9822cf48-f14b-409a-b601-383e27e08e5c could not be found. Sep 13 06:39:36.549114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '9822cf48-f14b-409a-b601-383e27e08e5c'} Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9822cf48-f14b-409a-b601-383e27e08e5c could not be found. Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:39:36.549895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9822cf48-f14b-409a-b601-383e27e08e5c could not be found. Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9822cf48-f14b-409a-b601-383e27e08e5c could not be found. Sep 13 06:39:36.551033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:39:36.552227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] Returning 404 to user: Instance 9822cf48-f14b-409a-b601-383e27e08e5c could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:39:36.552227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-20131e8d-ffed-4f79-8d6f-aa72c7079b12 tempest-VolumesNegativeTest-696271780 tempest-VolumesNegativeTest-696271780-project] 10.222.0.17 "GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c" status: 404 len: 111 microversion: 2.1 time: 0.031310 Sep 13 06:39:36.552227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 152/295] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:36 2022] GET /compute/v2.1/servers/9822cf48-f14b-409a-b601-383e27e08e5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:39:36.753003 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c789bda9-37ec-440c-b0c7-c0c73725cf98 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:39:36.755391 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c789bda9-37ec-440c-b0c7-c0c73725cf98 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:36.761762 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c789bda9-37ec-440c-b0c7-c0c73725cf98 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:36.762322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c789bda9-37ec-440c-b0c7-c0c73725cf98 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:36.762835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c789bda9-37ec-440c-b0c7-c0c73725cf98 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:36.763711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c789bda9-37ec-440c-b0c7-c0c73725cf98 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:36.764261 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c789bda9-37ec-440c-b0c7-c0c73725cf98 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:36.764674 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c789bda9-37ec-440c-b0c7-c0c73725cf98 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:36.790182 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-c789bda9-37ec-440c-b0c7-c0c73725cf98 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lazy-loading 'flavor' on Instance uuid 4b78adc0-900e-4630-beef-06cd4f0ae257 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:39:36.862416 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c789bda9-37ec-440c-b0c7-c0c73725cf98 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257/action" status: 200 len: 32 microversion: 2.1 time: 0.113262 Sep 13 06:39:36.863054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 144/296] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:39:36 2022] POST /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 06:39:36.873824 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6c52d5c6-db22-4f34-83cf-e69b5ed99c57 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:36.874427 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6c52d5c6-db22-4f34-83cf-e69b5ed99c57 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:36.880644 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c52d5c6-db22-4f34-83cf-e69b5ed99c57 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:36.881328 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c52d5c6-db22-4f34-83cf-e69b5ed99c57 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:36.882061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c52d5c6-db22-4f34-83cf-e69b5ed99c57 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:36.883465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c52d5c6-db22-4f34-83cf-e69b5ed99c57 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:36.883962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c52d5c6-db22-4f34-83cf-e69b5ed99c57 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:36.884680 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c52d5c6-db22-4f34-83cf-e69b5ed99c57 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:37.032553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6c52d5c6-db22-4f34-83cf-e69b5ed99c57 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:37.041159 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6c52d5c6-db22-4f34-83cf-e69b5ed99c57 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.172280 Sep 13 06:39:37.041736 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 153/297] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:36 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:38.066154 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7e989258-7cd1-456b-9392-4d09e54c4853 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:38.066858 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7e989258-7cd1-456b-9392-4d09e54c4853 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:38.073153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7e989258-7cd1-456b-9392-4d09e54c4853 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:38.073635 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7e989258-7cd1-456b-9392-4d09e54c4853 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:38.074065 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7e989258-7cd1-456b-9392-4d09e54c4853 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:38.075267 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7e989258-7cd1-456b-9392-4d09e54c4853 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:38.075768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7e989258-7cd1-456b-9392-4d09e54c4853 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:38.076247 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7e989258-7cd1-456b-9392-4d09e54c4853 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:38.219992 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7e989258-7cd1-456b-9392-4d09e54c4853 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:38.227910 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7e989258-7cd1-456b-9392-4d09e54c4853 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.166608 Sep 13 06:39:38.228502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 145/298] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:38 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:39.250217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8ed8c28a-8105-41cc-8242-c87ce5bbf40c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:39.250937 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8ed8c28a-8105-41cc-8242-c87ce5bbf40c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:39.256880 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ed8c28a-8105-41cc-8242-c87ce5bbf40c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:39.257365 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ed8c28a-8105-41cc-8242-c87ce5bbf40c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:39.257801 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ed8c28a-8105-41cc-8242-c87ce5bbf40c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:39.258487 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ed8c28a-8105-41cc-8242-c87ce5bbf40c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:39.258965 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ed8c28a-8105-41cc-8242-c87ce5bbf40c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:39.259410 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ed8c28a-8105-41cc-8242-c87ce5bbf40c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:39.398085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8ed8c28a-8105-41cc-8242-c87ce5bbf40c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:39.406401 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8ed8c28a-8105-41cc-8242-c87ce5bbf40c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.160435 Sep 13 06:39:39.419471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 154/299] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:39 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:40.429783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-69349993-376f-4dfe-98c1-76b700c3d1b3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:40.430418 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-69349993-376f-4dfe-98c1-76b700c3d1b3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:40.437563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69349993-376f-4dfe-98c1-76b700c3d1b3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:40.437976 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69349993-376f-4dfe-98c1-76b700c3d1b3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:40.438405 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69349993-376f-4dfe-98c1-76b700c3d1b3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:40.439544 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69349993-376f-4dfe-98c1-76b700c3d1b3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:40.440001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69349993-376f-4dfe-98c1-76b700c3d1b3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:40.440444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69349993-376f-4dfe-98c1-76b700c3d1b3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:40.581000 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-69349993-376f-4dfe-98c1-76b700c3d1b3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:40.589030 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-69349993-376f-4dfe-98c1-76b700c3d1b3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.163065 Sep 13 06:39:40.589598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 146/300] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:40 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:41.611747 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7dbf600b-b4f6-44ba-bab3-1eb8d88f8842 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:41.612329 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7dbf600b-b4f6-44ba-bab3-1eb8d88f8842 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:41.618130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7dbf600b-b4f6-44ba-bab3-1eb8d88f8842 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:41.618602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7dbf600b-b4f6-44ba-bab3-1eb8d88f8842 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:41.619026 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7dbf600b-b4f6-44ba-bab3-1eb8d88f8842 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:41.619731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7dbf600b-b4f6-44ba-bab3-1eb8d88f8842 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:41.620181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7dbf600b-b4f6-44ba-bab3-1eb8d88f8842 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:41.620595 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7dbf600b-b4f6-44ba-bab3-1eb8d88f8842 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:41.752449 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7dbf600b-b4f6-44ba-bab3-1eb8d88f8842 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:41.760123 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7dbf600b-b4f6-44ba-bab3-1eb8d88f8842 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.152215 Sep 13 06:39:41.760682 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 155/301] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:41 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:42.784345 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8b3402dc-4cbd-406b-bc61-45553079d206 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:42.784893 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8b3402dc-4cbd-406b-bc61-45553079d206 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:42.791592 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8b3402dc-4cbd-406b-bc61-45553079d206 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:42.792075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8b3402dc-4cbd-406b-bc61-45553079d206 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:42.792512 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8b3402dc-4cbd-406b-bc61-45553079d206 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:42.793199 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8b3402dc-4cbd-406b-bc61-45553079d206 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:42.793651 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8b3402dc-4cbd-406b-bc61-45553079d206 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:42.794071 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8b3402dc-4cbd-406b-bc61-45553079d206 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:42.920009 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8b3402dc-4cbd-406b-bc61-45553079d206 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:42.927539 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8b3402dc-4cbd-406b-bc61-45553079d206 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.147066 Sep 13 06:39:42.928095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 147/302] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:42 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:43.950589 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6968a00a-0ec1-41d9-9e5c-3fdd7c25d0df tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:43.951200 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6968a00a-0ec1-41d9-9e5c-3fdd7c25d0df tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:43.957128 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6968a00a-0ec1-41d9-9e5c-3fdd7c25d0df tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:43.957610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6968a00a-0ec1-41d9-9e5c-3fdd7c25d0df tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:43.958037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6968a00a-0ec1-41d9-9e5c-3fdd7c25d0df tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:43.958723 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6968a00a-0ec1-41d9-9e5c-3fdd7c25d0df tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:43.959172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6968a00a-0ec1-41d9-9e5c-3fdd7c25d0df tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:43.959619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6968a00a-0ec1-41d9-9e5c-3fdd7c25d0df tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:43.978240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:44.090373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6968a00a-0ec1-41d9-9e5c-3fdd7c25d0df tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:44.098038 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6968a00a-0ec1-41d9-9e5c-3fdd7c25d0df tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.151947 Sep 13 06:39:44.098605 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 156/303] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:43 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:45.121361 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-77368e42-3a8b-4a76-b77d-d082d9cc92d4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:45.121974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-77368e42-3a8b-4a76-b77d-d082d9cc92d4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:45.130654 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77368e42-3a8b-4a76-b77d-d082d9cc92d4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:45.131150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77368e42-3a8b-4a76-b77d-d082d9cc92d4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:45.131627 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77368e42-3a8b-4a76-b77d-d082d9cc92d4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:45.132328 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77368e42-3a8b-4a76-b77d-d082d9cc92d4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:45.132783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77368e42-3a8b-4a76-b77d-d082d9cc92d4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:45.133212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77368e42-3a8b-4a76-b77d-d082d9cc92d4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:45.329719 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-77368e42-3a8b-4a76-b77d-d082d9cc92d4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:45.337405 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-77368e42-3a8b-4a76-b77d-d082d9cc92d4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.219974 Sep 13 06:39:45.337978 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 148/304] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:45 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:46.359839 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-cf89f003-6882-4207-98e4-5cc452b49c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:46.360406 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-cf89f003-6882-4207-98e4-5cc452b49c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:46.366158 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf89f003-6882-4207-98e4-5cc452b49c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:46.366635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf89f003-6882-4207-98e4-5cc452b49c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:46.367065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf89f003-6882-4207-98e4-5cc452b49c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:46.367768 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf89f003-6882-4207-98e4-5cc452b49c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:46.368216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf89f003-6882-4207-98e4-5cc452b49c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:46.368632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf89f003-6882-4207-98e4-5cc452b49c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:46.501004 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-cf89f003-6882-4207-98e4-5cc452b49c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:46.510025 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-cf89f003-6882-4207-98e4-5cc452b49c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.153926 Sep 13 06:39:46.510500 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 157/305] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:46 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:47.533325 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7450d585-993c-4035-b2e5-ac72d4b12ec3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:47.533938 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7450d585-993c-4035-b2e5-ac72d4b12ec3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:47.540808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7450d585-993c-4035-b2e5-ac72d4b12ec3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:47.541390 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7450d585-993c-4035-b2e5-ac72d4b12ec3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:47.541732 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7450d585-993c-4035-b2e5-ac72d4b12ec3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:47.542431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7450d585-993c-4035-b2e5-ac72d4b12ec3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:47.542911 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7450d585-993c-4035-b2e5-ac72d4b12ec3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:47.544756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7450d585-993c-4035-b2e5-ac72d4b12ec3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:47.682055 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7450d585-993c-4035-b2e5-ac72d4b12ec3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:47.691686 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7450d585-993c-4035-b2e5-ac72d4b12ec3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.162085 Sep 13 06:39:47.692363 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 149/306] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:47 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:48.715765 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6dd8af55-45e9-4faf-96ff-90aab68db28b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:48.716307 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6dd8af55-45e9-4faf-96ff-90aab68db28b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:48.722360 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6dd8af55-45e9-4faf-96ff-90aab68db28b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:48.722840 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6dd8af55-45e9-4faf-96ff-90aab68db28b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:48.723296 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6dd8af55-45e9-4faf-96ff-90aab68db28b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:48.724012 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6dd8af55-45e9-4faf-96ff-90aab68db28b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:48.724464 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6dd8af55-45e9-4faf-96ff-90aab68db28b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:48.724882 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6dd8af55-45e9-4faf-96ff-90aab68db28b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:48.854748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6dd8af55-45e9-4faf-96ff-90aab68db28b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:48.863077 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6dd8af55-45e9-4faf-96ff-90aab68db28b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.151140 Sep 13 06:39:48.863732 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 158/307] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:48 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:49.886036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-25ff2c44-f020-49f0-bad2-f5ffa18bc7c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:49.887291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-25ff2c44-f020-49f0-bad2-f5ffa18bc7c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:49.893619 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-25ff2c44-f020-49f0-bad2-f5ffa18bc7c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:49.894096 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-25ff2c44-f020-49f0-bad2-f5ffa18bc7c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:49.894526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-25ff2c44-f020-49f0-bad2-f5ffa18bc7c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:49.895232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-25ff2c44-f020-49f0-bad2-f5ffa18bc7c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:49.895711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-25ff2c44-f020-49f0-bad2-f5ffa18bc7c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:49.896128 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-25ff2c44-f020-49f0-bad2-f5ffa18bc7c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:50.025086 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-25ff2c44-f020-49f0-bad2-f5ffa18bc7c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:50.032667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-25ff2c44-f020-49f0-bad2-f5ffa18bc7c3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.150574 Sep 13 06:39:50.033222 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 150/308] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:49 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:51.055877 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-15b11131-580d-4f23-ad05-0fc924ffc200 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:51.056472 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-15b11131-580d-4f23-ad05-0fc924ffc200 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:51.063070 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-15b11131-580d-4f23-ad05-0fc924ffc200 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:51.063582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-15b11131-580d-4f23-ad05-0fc924ffc200 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:51.064014 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-15b11131-580d-4f23-ad05-0fc924ffc200 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:51.064705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-15b11131-580d-4f23-ad05-0fc924ffc200 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:51.065137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-15b11131-580d-4f23-ad05-0fc924ffc200 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:51.065804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-15b11131-580d-4f23-ad05-0fc924ffc200 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:51.195627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-15b11131-580d-4f23-ad05-0fc924ffc200 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:51.203752 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-15b11131-580d-4f23-ad05-0fc924ffc200 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.151816 Sep 13 06:39:51.204313 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 159/309] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:51 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:52.226072 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fd801273-d3d1-4024-9c28-1ff3ca3d8c11 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:52.226687 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fd801273-d3d1-4024-9c28-1ff3ca3d8c11 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:52.233055 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd801273-d3d1-4024-9c28-1ff3ca3d8c11 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:52.233545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd801273-d3d1-4024-9c28-1ff3ca3d8c11 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:52.233980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd801273-d3d1-4024-9c28-1ff3ca3d8c11 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:52.234668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd801273-d3d1-4024-9c28-1ff3ca3d8c11 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:52.235123 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd801273-d3d1-4024-9c28-1ff3ca3d8c11 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:52.235584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd801273-d3d1-4024-9c28-1ff3ca3d8c11 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:52.520197 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fd801273-d3d1-4024-9c28-1ff3ca3d8c11 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:52.528419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fd801273-d3d1-4024-9c28-1ff3ca3d8c11 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.306110 Sep 13 06:39:52.529463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 151/310] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:52 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:39:53.552092 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5ab4bf08-64e8-411e-818d-7c693082ca87 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:53.552737 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5ab4bf08-64e8-411e-818d-7c693082ca87 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:53.558941 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab4bf08-64e8-411e-818d-7c693082ca87 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:53.559487 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab4bf08-64e8-411e-818d-7c693082ca87 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:53.559919 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab4bf08-64e8-411e-818d-7c693082ca87 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:53.560611 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab4bf08-64e8-411e-818d-7c693082ca87 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:53.561114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab4bf08-64e8-411e-818d-7c693082ca87 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:53.561540 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab4bf08-64e8-411e-818d-7c693082ca87 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:53.696800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5ab4bf08-64e8-411e-818d-7c693082ca87 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:53.705331 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5ab4bf08-64e8-411e-818d-7c693082ca87 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.156946 Sep 13 06:39:53.705906 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 160/311] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:53 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:54.728476 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b35fcbf7-3c79-47b5-9e3d-29d6770621e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:54.729093 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b35fcbf7-3c79-47b5-9e3d-29d6770621e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:54.735906 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b35fcbf7-3c79-47b5-9e3d-29d6770621e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:54.736648 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b35fcbf7-3c79-47b5-9e3d-29d6770621e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:54.737090 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b35fcbf7-3c79-47b5-9e3d-29d6770621e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:54.737763 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b35fcbf7-3c79-47b5-9e3d-29d6770621e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:54.738212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b35fcbf7-3c79-47b5-9e3d-29d6770621e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:54.738627 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b35fcbf7-3c79-47b5-9e3d-29d6770621e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:54.864595 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b35fcbf7-3c79-47b5-9e3d-29d6770621e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:54.872877 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b35fcbf7-3c79-47b5-9e3d-29d6770621e5 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.148201 Sep 13 06:39:54.873435 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 152/312] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:54 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:55.895156 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3a7806f3-de00-4114-81b7-9f96e5364a13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:55.895734 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3a7806f3-de00-4114-81b7-9f96e5364a13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:55.897559 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:55.902728 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a7806f3-de00-4114-81b7-9f96e5364a13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:55.902924 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a7806f3-de00-4114-81b7-9f96e5364a13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:55.903412 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a7806f3-de00-4114-81b7-9f96e5364a13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:55.904104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a7806f3-de00-4114-81b7-9f96e5364a13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:55.904564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a7806f3-de00-4114-81b7-9f96e5364a13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:55.904981 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3a7806f3-de00-4114-81b7-9f96e5364a13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:56.037594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3a7806f3-de00-4114-81b7-9f96e5364a13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:56.045960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3a7806f3-de00-4114-81b7-9f96e5364a13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.154721 Sep 13 06:39:56.046524 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 161/313] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:55 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:57.069164 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a6828206-3aad-4532-9ecb-55825f2752cc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:57.069775 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a6828206-3aad-4532-9ecb-55825f2752cc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:57.076172 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6828206-3aad-4532-9ecb-55825f2752cc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:57.076651 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6828206-3aad-4532-9ecb-55825f2752cc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:57.077084 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6828206-3aad-4532-9ecb-55825f2752cc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:57.077772 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6828206-3aad-4532-9ecb-55825f2752cc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:57.078227 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6828206-3aad-4532-9ecb-55825f2752cc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:57.078650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6828206-3aad-4532-9ecb-55825f2752cc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:57.093084 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:57.212169 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a6828206-3aad-4532-9ecb-55825f2752cc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:57.220282 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a6828206-3aad-4532-9ecb-55825f2752cc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.154925 Sep 13 06:39:57.220840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 153/314] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:57 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:58.243733 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-afdc525a-fe6d-4af0-bab4-570f45e064ee tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:58.244342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-afdc525a-fe6d-4af0-bab4-570f45e064ee tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:58.250689 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-afdc525a-fe6d-4af0-bab4-570f45e064ee tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:58.251162 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-afdc525a-fe6d-4af0-bab4-570f45e064ee tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:58.251620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-afdc525a-fe6d-4af0-bab4-570f45e064ee tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:58.252300 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-afdc525a-fe6d-4af0-bab4-570f45e064ee tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:58.252754 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-afdc525a-fe6d-4af0-bab4-570f45e064ee tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:58.253171 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-afdc525a-fe6d-4af0-bab4-570f45e064ee tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:58.388456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-afdc525a-fe6d-4af0-bab4-570f45e064ee tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:58.396144 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-afdc525a-fe6d-4af0-bab4-570f45e064ee tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.156307 Sep 13 06:39:58.396729 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 162/315] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:58 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:39:59.419506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6efb7e0b-82d1-4ae1-92e5-6cfa2de53fa3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:39:59.420113 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6efb7e0b-82d1-4ae1-92e5-6cfa2de53fa3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:39:59.427005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6efb7e0b-82d1-4ae1-92e5-6cfa2de53fa3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:59.427540 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6efb7e0b-82d1-4ae1-92e5-6cfa2de53fa3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:59.428100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6efb7e0b-82d1-4ae1-92e5-6cfa2de53fa3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:59.428803 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6efb7e0b-82d1-4ae1-92e5-6cfa2de53fa3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:39:59.429415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6efb7e0b-82d1-4ae1-92e5-6cfa2de53fa3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:39:59.429846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6efb7e0b-82d1-4ae1-92e5-6cfa2de53fa3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:39:59.564925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6efb7e0b-82d1-4ae1-92e5-6cfa2de53fa3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:39:59.572478 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6efb7e0b-82d1-4ae1-92e5-6cfa2de53fa3 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.156941 Sep 13 06:39:59.573033 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 154/316] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:39:59 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:00.595766 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7b99bc4c-d068-41a9-ae40-43d4d6ca0f44 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:00.596445 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7b99bc4c-d068-41a9-ae40-43d4d6ca0f44 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:00.602930 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7b99bc4c-d068-41a9-ae40-43d4d6ca0f44 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:00.603427 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7b99bc4c-d068-41a9-ae40-43d4d6ca0f44 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:00.603855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7b99bc4c-d068-41a9-ae40-43d4d6ca0f44 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:00.604812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7b99bc4c-d068-41a9-ae40-43d4d6ca0f44 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:00.605293 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7b99bc4c-d068-41a9-ae40-43d4d6ca0f44 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:00.605678 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7b99bc4c-d068-41a9-ae40-43d4d6ca0f44 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:00.737262 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7b99bc4c-d068-41a9-ae40-43d4d6ca0f44 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:00.744754 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7b99bc4c-d068-41a9-ae40-43d4d6ca0f44 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.152887 Sep 13 06:40:00.745343 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 163/317] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:00 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:01.767544 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-13ca248e-1fd2-4af4-b6ff-14618805e458 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:01.768090 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-13ca248e-1fd2-4af4-b6ff-14618805e458 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:01.770334 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=30 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:01.775496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-13ca248e-1fd2-4af4-b6ff-14618805e458 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:01.775983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-13ca248e-1fd2-4af4-b6ff-14618805e458 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:01.776925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-13ca248e-1fd2-4af4-b6ff-14618805e458 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:01.777612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-13ca248e-1fd2-4af4-b6ff-14618805e458 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:01.778062 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-13ca248e-1fd2-4af4-b6ff-14618805e458 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:01.778479 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-13ca248e-1fd2-4af4-b6ff-14618805e458 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:01.910212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-13ca248e-1fd2-4af4-b6ff-14618805e458 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:01.918669 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-13ca248e-1fd2-4af4-b6ff-14618805e458 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.155108 Sep 13 06:40:01.919220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 155/318] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:01 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:02.941091 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-322951f9-7ab3-4c32-b6b8-e503161a6ca0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:02.941690 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-322951f9-7ab3-4c32-b6b8-e503161a6ca0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:02.947550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-322951f9-7ab3-4c32-b6b8-e503161a6ca0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:02.948025 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-322951f9-7ab3-4c32-b6b8-e503161a6ca0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:02.948454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-322951f9-7ab3-4c32-b6b8-e503161a6ca0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:02.949129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-322951f9-7ab3-4c32-b6b8-e503161a6ca0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:02.949578 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-322951f9-7ab3-4c32-b6b8-e503161a6ca0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:02.949995 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-322951f9-7ab3-4c32-b6b8-e503161a6ca0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:03.075949 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-322951f9-7ab3-4c32-b6b8-e503161a6ca0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:03.083519 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-322951f9-7ab3-4c32-b6b8-e503161a6ca0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.146258 Sep 13 06:40:03.084079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 164/319] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:02 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:04.106527 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-dc60536f-5a07-4d87-96cc-0bdc60a4ce02 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:04.107126 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-dc60536f-5a07-4d87-96cc-0bdc60a4ce02 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:04.113442 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc60536f-5a07-4d87-96cc-0bdc60a4ce02 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:04.113925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc60536f-5a07-4d87-96cc-0bdc60a4ce02 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:04.114359 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc60536f-5a07-4d87-96cc-0bdc60a4ce02 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:04.115048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc60536f-5a07-4d87-96cc-0bdc60a4ce02 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:04.115532 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc60536f-5a07-4d87-96cc-0bdc60a4ce02 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:04.116011 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc60536f-5a07-4d87-96cc-0bdc60a4ce02 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:04.247281 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dc60536f-5a07-4d87-96cc-0bdc60a4ce02 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:04.254851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-dc60536f-5a07-4d87-96cc-0bdc60a4ce02 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.152817 Sep 13 06:40:04.255428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 156/320] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:04 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:05.277038 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-16d5d665-3572-48db-86a6-6548d01db796 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:05.277667 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-16d5d665-3572-48db-86a6-6548d01db796 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:05.283608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16d5d665-3572-48db-86a6-6548d01db796 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:05.284084 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16d5d665-3572-48db-86a6-6548d01db796 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:05.284511 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16d5d665-3572-48db-86a6-6548d01db796 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:05.285216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16d5d665-3572-48db-86a6-6548d01db796 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:05.286052 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16d5d665-3572-48db-86a6-6548d01db796 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:05.286302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16d5d665-3572-48db-86a6-6548d01db796 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:05.412997 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-16d5d665-3572-48db-86a6-6548d01db796 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:05.421853 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-16d5d665-3572-48db-86a6-6548d01db796 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.148656 Sep 13 06:40:05.422407 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 165/321] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:05 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:06.444905 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-639a1d1c-4324-479d-8bd5-9ee63d61ed3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:06.445975 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-639a1d1c-4324-479d-8bd5-9ee63d61ed3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:06.455093 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639a1d1c-4324-479d-8bd5-9ee63d61ed3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:06.455542 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639a1d1c-4324-479d-8bd5-9ee63d61ed3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:06.456077 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639a1d1c-4324-479d-8bd5-9ee63d61ed3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:06.456685 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639a1d1c-4324-479d-8bd5-9ee63d61ed3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:06.457144 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639a1d1c-4324-479d-8bd5-9ee63d61ed3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:06.457567 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639a1d1c-4324-479d-8bd5-9ee63d61ed3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:06.590823 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-639a1d1c-4324-479d-8bd5-9ee63d61ed3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:06.598523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-639a1d1c-4324-479d-8bd5-9ee63d61ed3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.157748 Sep 13 06:40:06.599077 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 157/322] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:06 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:07.621777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7f331d70-089e-4e2d-9c36-55d9e4cb68d8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:07.622408 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7f331d70-089e-4e2d-9c36-55d9e4cb68d8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:07.628271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f331d70-089e-4e2d-9c36-55d9e4cb68d8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:07.628743 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f331d70-089e-4e2d-9c36-55d9e4cb68d8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:07.629168 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f331d70-089e-4e2d-9c36-55d9e4cb68d8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:07.629838 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f331d70-089e-4e2d-9c36-55d9e4cb68d8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:07.630282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f331d70-089e-4e2d-9c36-55d9e4cb68d8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:07.630721 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f331d70-089e-4e2d-9c36-55d9e4cb68d8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:07.761857 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7f331d70-089e-4e2d-9c36-55d9e4cb68d8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:07.769570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7f331d70-089e-4e2d-9c36-55d9e4cb68d8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.151639 Sep 13 06:40:07.770170 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 166/323] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:07 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:08.793859 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-372333cf-e2e7-4495-b50c-56f2411f6801 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:08.794410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-372333cf-e2e7-4495-b50c-56f2411f6801 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:08.800599 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372333cf-e2e7-4495-b50c-56f2411f6801 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:08.801083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372333cf-e2e7-4495-b50c-56f2411f6801 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:08.801522 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372333cf-e2e7-4495-b50c-56f2411f6801 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:08.802382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372333cf-e2e7-4495-b50c-56f2411f6801 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:08.802907 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372333cf-e2e7-4495-b50c-56f2411f6801 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:08.803331 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372333cf-e2e7-4495-b50c-56f2411f6801 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:08.935382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-372333cf-e2e7-4495-b50c-56f2411f6801 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:08.943072 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-372333cf-e2e7-4495-b50c-56f2411f6801 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.154078 Sep 13 06:40:08.943692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 158/324] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:08 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:09.969390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c672fb5a-731f-4eaa-9016-a63d54030ed8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:09.970084 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c672fb5a-731f-4eaa-9016-a63d54030ed8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:09.976806 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c672fb5a-731f-4eaa-9016-a63d54030ed8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:09.977400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c672fb5a-731f-4eaa-9016-a63d54030ed8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:09.977842 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c672fb5a-731f-4eaa-9016-a63d54030ed8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:09.978779 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c672fb5a-731f-4eaa-9016-a63d54030ed8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:09.979245 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c672fb5a-731f-4eaa-9016-a63d54030ed8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:09.979750 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c672fb5a-731f-4eaa-9016-a63d54030ed8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:10.122829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c672fb5a-731f-4eaa-9016-a63d54030ed8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:10.130664 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c672fb5a-731f-4eaa-9016-a63d54030ed8 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.165647 Sep 13 06:40:10.131263 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 167/325] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:09 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:11.154189 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5e32ff64-899c-4582-9251-e802fcf5d7a9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:11.154726 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5e32ff64-899c-4582-9251-e802fcf5d7a9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:11.161329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e32ff64-899c-4582-9251-e802fcf5d7a9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:11.161896 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e32ff64-899c-4582-9251-e802fcf5d7a9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:11.162516 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e32ff64-899c-4582-9251-e802fcf5d7a9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:11.163409 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e32ff64-899c-4582-9251-e802fcf5d7a9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:11.164036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e32ff64-899c-4582-9251-e802fcf5d7a9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:11.164466 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e32ff64-899c-4582-9251-e802fcf5d7a9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:11.306670 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5e32ff64-899c-4582-9251-e802fcf5d7a9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:11.315679 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5e32ff64-899c-4582-9251-e802fcf5d7a9 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.165470 Sep 13 06:40:11.316355 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 159/326] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:11 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:12.339178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-298fc97a-6850-4a16-b46f-9dcb988224e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:12.339909 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-298fc97a-6850-4a16-b46f-9dcb988224e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:12.347162 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-298fc97a-6850-4a16-b46f-9dcb988224e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:12.347677 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-298fc97a-6850-4a16-b46f-9dcb988224e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:12.348112 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-298fc97a-6850-4a16-b46f-9dcb988224e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:12.348813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-298fc97a-6850-4a16-b46f-9dcb988224e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:12.349449 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-298fc97a-6850-4a16-b46f-9dcb988224e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:12.349879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-298fc97a-6850-4a16-b46f-9dcb988224e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:12.720002 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-298fc97a-6850-4a16-b46f-9dcb988224e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:12.730114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-298fc97a-6850-4a16-b46f-9dcb988224e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.394206 Sep 13 06:40:12.730689 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 168/327] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:12 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:13.753919 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-032b4427-0f98-4e2b-84ce-274fa7911312 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:13.754523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-032b4427-0f98-4e2b-84ce-274fa7911312 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:13.761346 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-032b4427-0f98-4e2b-84ce-274fa7911312 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:13.762082 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-032b4427-0f98-4e2b-84ce-274fa7911312 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:13.762776 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-032b4427-0f98-4e2b-84ce-274fa7911312 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:13.763748 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-032b4427-0f98-4e2b-84ce-274fa7911312 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:13.764409 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-032b4427-0f98-4e2b-84ce-274fa7911312 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:13.764892 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-032b4427-0f98-4e2b-84ce-274fa7911312 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:13.953539 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-032b4427-0f98-4e2b-84ce-274fa7911312 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:13.961870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-032b4427-0f98-4e2b-84ce-274fa7911312 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.211703 Sep 13 06:40:13.962511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 160/328] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:13 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:14.986673 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-dade935b-6451-445c-9d11-8ca5ee8e8cfc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:14.988557 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-dade935b-6451-445c-9d11-8ca5ee8e8cfc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:14.995827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dade935b-6451-445c-9d11-8ca5ee8e8cfc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:14.996331 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dade935b-6451-445c-9d11-8ca5ee8e8cfc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:14.997250 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dade935b-6451-445c-9d11-8ca5ee8e8cfc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:14.998083 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dade935b-6451-445c-9d11-8ca5ee8e8cfc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:14.998553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dade935b-6451-445c-9d11-8ca5ee8e8cfc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:14.998974 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-dade935b-6451-445c-9d11-8ca5ee8e8cfc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:15.004987 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=75 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:15.179752 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-dade935b-6451-445c-9d11-8ca5ee8e8cfc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:15.189315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-dade935b-6451-445c-9d11-8ca5ee8e8cfc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.207506 Sep 13 06:40:15.189899 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 169/329] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:14 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:16.212728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f5ca48d2-d325-4a4e-9564-f21d683e8e7e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:16.214967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f5ca48d2-d325-4a4e-9564-f21d683e8e7e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:16.222664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f5ca48d2-d325-4a4e-9564-f21d683e8e7e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:16.223482 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f5ca48d2-d325-4a4e-9564-f21d683e8e7e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:16.224094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f5ca48d2-d325-4a4e-9564-f21d683e8e7e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:16.225160 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f5ca48d2-d325-4a4e-9564-f21d683e8e7e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:16.225807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f5ca48d2-d325-4a4e-9564-f21d683e8e7e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:16.226413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f5ca48d2-d325-4a4e-9564-f21d683e8e7e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:16.449839 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f5ca48d2-d325-4a4e-9564-f21d683e8e7e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:16.458788 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f5ca48d2-d325-4a4e-9564-f21d683e8e7e tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.249915 Sep 13 06:40:16.470232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 161/330] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:16 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:17.483125 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6ea3d4fd-71e8-4441-a8c9-df6c33fa675a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:17.484154 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6ea3d4fd-71e8-4441-a8c9-df6c33fa675a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:17.496220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ea3d4fd-71e8-4441-a8c9-df6c33fa675a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:17.496721 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ea3d4fd-71e8-4441-a8c9-df6c33fa675a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:17.498775 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ea3d4fd-71e8-4441-a8c9-df6c33fa675a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:17.502764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ea3d4fd-71e8-4441-a8c9-df6c33fa675a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:17.504165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ea3d4fd-71e8-4441-a8c9-df6c33fa675a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:17.505688 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ea3d4fd-71e8-4441-a8c9-df6c33fa675a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:17.820071 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6ea3d4fd-71e8-4441-a8c9-df6c33fa675a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:17.832533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6ea3d4fd-71e8-4441-a8c9-df6c33fa675a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1501 microversion: 2.1 time: 0.353791 Sep 13 06:40:17.835373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 170/331] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:17 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1501 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:17.858266 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07425257-2655-48de-9b02-c0e30069128a"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:17.861418 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:17.868667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:17.869640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:17.870820 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:17.871818 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:17.872497 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:17.873144 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:17.909195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] HTTP exception thrown: Cannot 'attach_volume' instance 4b78adc0-900e-4630-beef-06cd4f0ae257 while it is in vm_state rescued Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Request method failure captured: Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: POST /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257/os-volume_attachments HTTP/1.1 Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 74 Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUxj6MqqdqElfWqH5aL2gn96PspvAbbzhXgLFU2F58FTDBDdrp3Z0c7eG23xqOh3h_TUtlPq2VTks3rSAdpphS-zhqBW3JkCdCq4-0VW2eyujCWXjaQWWm-3_69zMNFPkvWhIwezm9zeAO9awvqOSnjKPXwSGxtcYdntZHsKh7LZj0 Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 2a2a801692c84c34b713aca165f69761 Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:40:17.911836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a2a801692c84c34b713aca165f69761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a2a801692c84c34b713aca165f69761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a2a801692c84c34b713aca165f69761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a2a801692c84c34b713aca165f69761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 2a2a801692c84c34b713aca165f69761 Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-ServerRescueNegativeTestJSON-1025991494-project Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 3a0a80a54cdc4107a508ca480b992319 Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1025991494-project Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {"volumeAttachment": {"volumeId": "07425257-2655-48de-9b02-c0e30069128a"}} Sep 13 06:40:17.913729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Cannot 'attach_volume' instance 4b78adc0-900e-4630-beef-06cd4f0ae257 while it is in vm_state rescued Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'server_id': '4b78adc0-900e-4630-beef-06cd4f0ae257', 'body': {'volumeAttachment': {'volumeId': '07425257-2655-48de-9b02-c0e30069128a'}}} Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b78adc0-900e-4630-beef-06cd4f0ae257 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:40:17.915179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4b78adc0-900e-4630-beef-06cd4f0ae257 while it is in vm_state rescued Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:40:17.917178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:40:17.919924 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:40:17.919924 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:40:17.919924 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4b78adc0-900e-4630-beef-06cd4f0ae257 while it is in vm_state rescued Sep 13 06:40:17.919924 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:40:17.921362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Returning 409 to user: Cannot 'attach_volume' instance 4b78adc0-900e-4630-beef-06cd4f0ae257 while it is in vm_state rescued {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:40:17.922461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1dd86011-7ab9-4416-aaca-fab80a6a7f46 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069315 Sep 13 06:40:17.926965 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 162/332] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:40:17 2022] POST /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 06:40:17.933044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-11681966-4f2e-4dec-9c17-c7ec0b4c2780 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:17.933781 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-11681966-4f2e-4dec-9c17-c7ec0b4c2780 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:17.943983 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11681966-4f2e-4dec-9c17-c7ec0b4c2780 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:17.945393 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11681966-4f2e-4dec-9c17-c7ec0b4c2780 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:17.946008 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11681966-4f2e-4dec-9c17-c7ec0b4c2780 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:17.948000 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11681966-4f2e-4dec-9c17-c7ec0b4c2780 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:17.948717 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11681966-4f2e-4dec-9c17-c7ec0b4c2780 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:17.949313 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11681966-4f2e-4dec-9c17-c7ec0b4c2780 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:18.101497 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-11681966-4f2e-4dec-9c17-c7ec0b4c2780 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257/action" status: 202 len: 0 microversion: 2.1 time: 0.173198 Sep 13 06:40:18.102442 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 171/333] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:40:17 2022] POST /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:40:18.116448 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e860ddf3-d570-4d11-b044-5617400ac40d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:18.116448 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e860ddf3-d570-4d11-b044-5617400ac40d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:18.144206 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e860ddf3-d570-4d11-b044-5617400ac40d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:18.144774 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e860ddf3-d570-4d11-b044-5617400ac40d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:18.145680 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e860ddf3-d570-4d11-b044-5617400ac40d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:18.146712 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e860ddf3-d570-4d11-b044-5617400ac40d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:18.147449 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e860ddf3-d570-4d11-b044-5617400ac40d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:18.148155 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e860ddf3-d570-4d11-b044-5617400ac40d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:18.342261 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e860ddf3-d570-4d11-b044-5617400ac40d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:18.354996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e860ddf3-d570-4d11-b044-5617400ac40d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1509 microversion: 2.1 time: 0.246943 Sep 13 06:40:18.356007 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 163/334] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:18 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:18.855327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1346242060", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-621610664", "security_groups": [{"name": "tempest-secgroup-smoke-209540783"}], "block_device_mapping_v2": [{"uuid": "ee8865b1-65f3-46f1-a21a-6bcd71957d32", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1bd1c3af-b1e3-4524-bee7-4fb25240d8e3"}]}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:19.035458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.network.neutron [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] validate_networks() for [('1bd1c3af-b1e3-4524-bee7-4fb25240d8e3', None, None, None, None, None)] {{(pid=132399) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:40:19.378196 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a3647f39-64b2-4d89-8d7e-4cdcc910c06f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:19.378804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a3647f39-64b2-4d89-8d7e-4cdcc910c06f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:19.388851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a3647f39-64b2-4d89-8d7e-4cdcc910c06f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:19.389908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a3647f39-64b2-4d89-8d7e-4cdcc910c06f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:19.390663 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a3647f39-64b2-4d89-8d7e-4cdcc910c06f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:19.391908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a3647f39-64b2-4d89-8d7e-4cdcc910c06f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:19.394748 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a3647f39-64b2-4d89-8d7e-4cdcc910c06f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:19.395594 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a3647f39-64b2-4d89-8d7e-4cdcc910c06f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:19.581768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a3647f39-64b2-4d89-8d7e-4cdcc910c06f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:19.592217 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a3647f39-64b2-4d89-8d7e-4cdcc910c06f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1509 microversion: 2.1 time: 0.217898 Sep 13 06:40:19.593499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 164/335] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:19 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:19.956886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Flavor limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:40:19.958428 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Image limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:40:19.958919 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Flavor pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:40:19.959333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Image pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:40:19.959792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:40:19.970667 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:19.971161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:19.971640 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:19.972379 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:19.972828 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:19.973255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:19.990346 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Getting quotas for project 5d92a2cc741d45aba5ac112718389c22. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:40:19.995244 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Getting quotas for user ca7cb5590aff4b0283cd583b391a5ffe and project 5d92a2cc741d45aba5ac112718389c22. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:40:20.074910 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Going to run 1 instances... {{(pid=132399) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:40:20.078044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee8865b1-65f3-46f1-a21a-6bcd71957d32',volume_size=None,volume_type=None)] {{(pid=132399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:40:20.244339 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3b55972c-ce80-4d4f-abe9-428c3c068514 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.394054 Sep 13 06:40:20.247149 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 172/336] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:40:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:40:20.259816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-95c2577d-8668-4e52-916c-b14f0698b19c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:20.260581 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-95c2577d-8668-4e52-916c-b14f0698b19c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:20.336142 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-95c2577d-8668-4e52-916c-b14f0698b19c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:20.345677 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-95c2577d-8668-4e52-916c-b14f0698b19c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1094 microversion: 2.1 time: 0.089719 Sep 13 06:40:20.346260 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 165/337] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:20 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:20.618713 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0efe8244-fb19-47cb-9634-efbf25e4e390 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:20.619625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0efe8244-fb19-47cb-9634-efbf25e4e390 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:20.626659 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0efe8244-fb19-47cb-9634-efbf25e4e390 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:20.627147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0efe8244-fb19-47cb-9634-efbf25e4e390 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:20.627672 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0efe8244-fb19-47cb-9634-efbf25e4e390 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:20.628376 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0efe8244-fb19-47cb-9634-efbf25e4e390 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:20.628827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0efe8244-fb19-47cb-9634-efbf25e4e390 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:20.629255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0efe8244-fb19-47cb-9634-efbf25e4e390 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:20.847338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0efe8244-fb19-47cb-9634-efbf25e4e390 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:20.855852 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0efe8244-fb19-47cb-9634-efbf25e4e390 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1509 microversion: 2.1 time: 0.243443 Sep 13 06:40:20.858080 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 173/338] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:20 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:21.370799 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9905cc2b-a6b2-4970-a5b0-59f1c73c6a85 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:21.371598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9905cc2b-a6b2-4970-a5b0-59f1c73c6a85 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:21.380281 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9905cc2b-a6b2-4970-a5b0-59f1c73c6a85 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:21.381546 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9905cc2b-a6b2-4970-a5b0-59f1c73c6a85 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:21.382680 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9905cc2b-a6b2-4970-a5b0-59f1c73c6a85 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:21.383646 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9905cc2b-a6b2-4970-a5b0-59f1c73c6a85 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:21.384345 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9905cc2b-a6b2-4970-a5b0-59f1c73c6a85 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:21.388095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9905cc2b-a6b2-4970-a5b0-59f1c73c6a85 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:21.508675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9905cc2b-a6b2-4970-a5b0-59f1c73c6a85 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:21.525787 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9905cc2b-a6b2-4970-a5b0-59f1c73c6a85 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1144 microversion: 2.1 time: 0.156440 Sep 13 06:40:21.526431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 166/339] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:21 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1144 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:21.925271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8490e23b-aaf8-456d-b2c5-1caa87b09674 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:21.925271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8490e23b-aaf8-456d-b2c5-1caa87b09674 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:21.950725 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8490e23b-aaf8-456d-b2c5-1caa87b09674 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:21.950725 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8490e23b-aaf8-456d-b2c5-1caa87b09674 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:21.950725 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8490e23b-aaf8-456d-b2c5-1caa87b09674 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:21.951334 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8490e23b-aaf8-456d-b2c5-1caa87b09674 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:21.952056 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8490e23b-aaf8-456d-b2c5-1caa87b09674 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:21.952741 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8490e23b-aaf8-456d-b2c5-1caa87b09674 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:22.097994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8490e23b-aaf8-456d-b2c5-1caa87b09674 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:22.109019 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8490e23b-aaf8-456d-b2c5-1caa87b09674 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1509 microversion: 2.1 time: 0.231584 Sep 13 06:40:22.110165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 174/340] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:21 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:22.549624 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-414ea364-fc58-44bc-9317-876182c7c020 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:22.550091 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-414ea364-fc58-44bc-9317-876182c7c020 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:22.565721 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-414ea364-fc58-44bc-9317-876182c7c020 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:22.566217 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-414ea364-fc58-44bc-9317-876182c7c020 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:22.566843 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-414ea364-fc58-44bc-9317-876182c7c020 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:22.567749 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-414ea364-fc58-44bc-9317-876182c7c020 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:22.568360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-414ea364-fc58-44bc-9317-876182c7c020 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:22.569239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-414ea364-fc58-44bc-9317-876182c7c020 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:22.660569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-414ea364-fc58-44bc-9317-876182c7c020 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:22.670731 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-414ea364-fc58-44bc-9317-876182c7c020 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1144 microversion: 2.1 time: 0.125783 Sep 13 06:40:22.671918 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 167/341] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:22 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1144 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:23.134476 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bb54ae7c-2d3e-4d14-af07-4e2fb0fa8485 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:23.136103 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-bb54ae7c-2d3e-4d14-af07-4e2fb0fa8485 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:23.146943 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bb54ae7c-2d3e-4d14-af07-4e2fb0fa8485 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:23.147480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bb54ae7c-2d3e-4d14-af07-4e2fb0fa8485 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:23.147923 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bb54ae7c-2d3e-4d14-af07-4e2fb0fa8485 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:23.156377 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bb54ae7c-2d3e-4d14-af07-4e2fb0fa8485 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:23.157812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bb54ae7c-2d3e-4d14-af07-4e2fb0fa8485 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:23.159703 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bb54ae7c-2d3e-4d14-af07-4e2fb0fa8485 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:23.504760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-bb54ae7c-2d3e-4d14-af07-4e2fb0fa8485 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:23.512865 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-bb54ae7c-2d3e-4d14-af07-4e2fb0fa8485 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1509 microversion: 2.1 time: 0.382372 Sep 13 06:40:23.530222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 175/342] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:23 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:23.693493 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-39e7e990-dbd4-41ea-8c3b-bfee675f0f34 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:23.694869 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-39e7e990-dbd4-41ea-8c3b-bfee675f0f34 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:23.701935 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-39e7e990-dbd4-41ea-8c3b-bfee675f0f34 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:23.702519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-39e7e990-dbd4-41ea-8c3b-bfee675f0f34 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:23.703229 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-39e7e990-dbd4-41ea-8c3b-bfee675f0f34 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:23.704203 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-39e7e990-dbd4-41ea-8c3b-bfee675f0f34 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:23.704877 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-39e7e990-dbd4-41ea-8c3b-bfee675f0f34 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:23.705518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-39e7e990-dbd4-41ea-8c3b-bfee675f0f34 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:23.781178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-39e7e990-dbd4-41ea-8c3b-bfee675f0f34 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:23.792340 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-39e7e990-dbd4-41ea-8c3b-bfee675f0f34 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1192 microversion: 2.1 time: 0.102524 Sep 13 06:40:23.793193 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 168/343] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:23 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:24.537327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-98325d95-56f7-4e80-b27a-093855a407ca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:24.537961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-98325d95-56f7-4e80-b27a-093855a407ca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:24.547376 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98325d95-56f7-4e80-b27a-093855a407ca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:24.548072 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98325d95-56f7-4e80-b27a-093855a407ca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:24.548679 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98325d95-56f7-4e80-b27a-093855a407ca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:24.550052 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98325d95-56f7-4e80-b27a-093855a407ca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:24.551190 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98325d95-56f7-4e80-b27a-093855a407ca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:24.551828 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98325d95-56f7-4e80-b27a-093855a407ca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:24.815476 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7b9416d1-a4fd-4656-bd25-d7696b66d1b2 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:24.816536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7b9416d1-a4fd-4656-bd25-d7696b66d1b2 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:24.824377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b9416d1-a4fd-4656-bd25-d7696b66d1b2 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:24.824871 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b9416d1-a4fd-4656-bd25-d7696b66d1b2 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:24.825305 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b9416d1-a4fd-4656-bd25-d7696b66d1b2 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:24.825996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b9416d1-a4fd-4656-bd25-d7696b66d1b2 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:24.826461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b9416d1-a4fd-4656-bd25-d7696b66d1b2 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:24.826870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b9416d1-a4fd-4656-bd25-d7696b66d1b2 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:24.843384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-98325d95-56f7-4e80-b27a-093855a407ca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:24.858115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-98325d95-56f7-4e80-b27a-093855a407ca tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1509 microversion: 2.1 time: 0.325195 Sep 13 06:40:24.873501 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 176/344] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:24 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1509 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:24.907262 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7b9416d1-a4fd-4656-bd25-d7696b66d1b2 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:24.916393 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7b9416d1-a4fd-4656-bd25-d7696b66d1b2 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1210 microversion: 2.1 time: 0.104933 Sep 13 06:40:24.916967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 169/345] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:24 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:25.882733 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4a960f2a-7e0b-43f0-b7be-4a03cbea8edc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:25.884197 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4a960f2a-7e0b-43f0-b7be-4a03cbea8edc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:25.891004 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4a960f2a-7e0b-43f0-b7be-4a03cbea8edc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:25.891740 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4a960f2a-7e0b-43f0-b7be-4a03cbea8edc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:25.892512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4a960f2a-7e0b-43f0-b7be-4a03cbea8edc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:25.893383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4a960f2a-7e0b-43f0-b7be-4a03cbea8edc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:25.893989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4a960f2a-7e0b-43f0-b7be-4a03cbea8edc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:25.894561 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4a960f2a-7e0b-43f0-b7be-4a03cbea8edc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:25.939981 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7d789c53-abeb-4694-9257-d5ace00e8c6c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:25.941203 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7d789c53-abeb-4694-9257-d5ace00e8c6c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:25.959746 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d789c53-abeb-4694-9257-d5ace00e8c6c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:25.960738 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d789c53-abeb-4694-9257-d5ace00e8c6c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:25.961439 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d789c53-abeb-4694-9257-d5ace00e8c6c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:25.962425 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d789c53-abeb-4694-9257-d5ace00e8c6c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:25.963141 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d789c53-abeb-4694-9257-d5ace00e8c6c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:25.963865 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d789c53-abeb-4694-9257-d5ace00e8c6c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:26.080875 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7d789c53-abeb-4694-9257-d5ace00e8c6c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:26.102087 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7d789c53-abeb-4694-9257-d5ace00e8c6c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1210 microversion: 2.1 time: 0.159201 Sep 13 06:40:26.103241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 170/346] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:25 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1210 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:26.137970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4a960f2a-7e0b-43f0-b7be-4a03cbea8edc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:26.147291 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4a960f2a-7e0b-43f0-b7be-4a03cbea8edc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1509 microversion: 2.1 time: 0.269865 Sep 13 06:40:26.168915 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 177/347] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:25 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:27.131789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a4ec0752-e91b-4da2-84ac-282febe9645b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:27.132746 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a4ec0752-e91b-4da2-84ac-282febe9645b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:27.151856 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4ec0752-e91b-4da2-84ac-282febe9645b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:27.153550 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4ec0752-e91b-4da2-84ac-282febe9645b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:27.154020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4ec0752-e91b-4da2-84ac-282febe9645b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:27.155830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4ec0752-e91b-4da2-84ac-282febe9645b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:27.156311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4ec0752-e91b-4da2-84ac-282febe9645b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:27.158246 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a4ec0752-e91b-4da2-84ac-282febe9645b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:27.162785 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=98 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:27.185779 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9965cfa4-c2ee-4283-96a8-6673cb7182af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:27.187323 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9965cfa4-c2ee-4283-96a8-6673cb7182af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:27.194851 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:27.202554 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9965cfa4-c2ee-4283-96a8-6673cb7182af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:27.203297 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9965cfa4-c2ee-4283-96a8-6673cb7182af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:27.206932 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9965cfa4-c2ee-4283-96a8-6673cb7182af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:27.208346 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9965cfa4-c2ee-4283-96a8-6673cb7182af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:27.208825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9965cfa4-c2ee-4283-96a8-6673cb7182af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:27.209257 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9965cfa4-c2ee-4283-96a8-6673cb7182af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:27.578182 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a4ec0752-e91b-4da2-84ac-282febe9645b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:27.604127 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9965cfa4-c2ee-4283-96a8-6673cb7182af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:27.605116 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a4ec0752-e91b-4da2-84ac-282febe9645b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1277 microversion: 2.1 time: 0.478425 Sep 13 06:40:27.615398 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 171/348] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:27 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1277 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:27.615787 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9965cfa4-c2ee-4283-96a8-6673cb7182af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1515 microversion: 2.1 time: 0.431370 Sep 13 06:40:27.615787 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 178/349] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:27 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1515 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:28.634266 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-11ad28c3-0399-4853-863e-7be3afae2867 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:28.636133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-11ad28c3-0399-4853-863e-7be3afae2867 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:28.643843 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-11ad28c3-0399-4853-863e-7be3afae2867 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:28.644554 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-11ad28c3-0399-4853-863e-7be3afae2867 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:28.645699 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-11ad28c3-0399-4853-863e-7be3afae2867 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:28.646708 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-11ad28c3-0399-4853-863e-7be3afae2867 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:28.647325 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-11ad28c3-0399-4853-863e-7be3afae2867 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:28.647777 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-11ad28c3-0399-4853-863e-7be3afae2867 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:28.678098 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-04270006-d912-498b-b659-f5db8227d39c req-e672eaf0-d55e-47cd-9c07-95704c0c103b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "462ba976-b35b-433e-b247-03eaef8428a5", "tag": "15fd17c0-6cb3-46dd-adc1-2ec4c2d2560d"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:28.690984 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-04270006-d912-498b-b659-f5db8227d39c req-e672eaf0-d55e-47cd-9c07-95704c0c103b service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:28.691707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-04270006-d912-498b-b659-f5db8227d39c req-e672eaf0-d55e-47cd-9c07-95704c0c103b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:28.692286 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-04270006-d912-498b-b659-f5db8227d39c req-e672eaf0-d55e-47cd-9c07-95704c0c103b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:28.705335 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-04270006-d912-498b-b659-f5db8227d39c req-e672eaf0-d55e-47cd-9c07-95704c0c103b service nova] Creating event network-changed:15fd17c0-6cb3-46dd-adc1-2ec4c2d2560d for instance 462ba976-b35b-433e-b247-03eaef8428a5 on hv-cinder-85638 Sep 13 06:40:28.711054 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-04270006-d912-498b-b659-f5db8227d39c req-e672eaf0-d55e-47cd-9c07-95704c0c103b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036460 Sep 13 06:40:28.712031 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 179/350] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:40:28.842774 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-11ad28c3-0399-4853-863e-7be3afae2867 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:28.851062 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-11ad28c3-0399-4853-863e-7be3afae2867 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.221409 Sep 13 06:40:28.855709 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 172/351] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:28 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:29.437657 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7695e158-1f52-40e1-b5bb-0831d538411b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'create', calling method: .version_select at 0x7fdc0d6dbca0>, body: {"keypair": {"name": "tempest-keypair-635113787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNosEFZMLWA6U5luDE3LnMnMGasZ8oazTXNwAazxqdP8yVvlKJETkbMdEHzLIgWHTdz7aIpIOj2ULrfOpn7gjO1s5b+dMhGkSf1GCm/IWTML2o6CMOC1uVgziq1V0l7PA=="}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:29.458848 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-7695e158-1f52-40e1-b5bb-0831d538411b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Getting quotas for project 2a2a801692c84c34b713aca165f69761. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:40:29.463112 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-7695e158-1f52-40e1-b5bb-0831d538411b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Getting quotas for user 3a0a80a54cdc4107a508ca480b992319 and project 2a2a801692c84c34b713aca165f69761. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:40:29.492721 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7695e158-1f52-40e1-b5bb-0831d538411b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059173 Sep 13 06:40:29.501411 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 180/352] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Sep 13 06:40:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:40:29.874464 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-288f201b-68b0-489b-8981-5e4c9a6b8fa3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:29.875078 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-288f201b-68b0-489b-8981-5e4c9a6b8fa3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:29.888793 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-288f201b-68b0-489b-8981-5e4c9a6b8fa3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:29.889633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-288f201b-68b0-489b-8981-5e4c9a6b8fa3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:29.894749 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-288f201b-68b0-489b-8981-5e4c9a6b8fa3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:29.896400 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-288f201b-68b0-489b-8981-5e4c9a6b8fa3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:29.896893 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-288f201b-68b0-489b-8981-5e4c9a6b8fa3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:29.897335 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-288f201b-68b0-489b-8981-5e4c9a6b8fa3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:30.071111 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-288f201b-68b0-489b-8981-5e4c9a6b8fa3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:30.080656 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-288f201b-68b0-489b-8981-5e4c9a6b8fa3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.210193 Sep 13 06:40:30.099738 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 173/353] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:29 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:31.107021 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-40edce74-e548-4b8a-a63b-985455c0440a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:31.108497 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-40edce74-e548-4b8a-a63b-985455c0440a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:31.110526 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:31.123427 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40edce74-e548-4b8a-a63b-985455c0440a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:31.125191 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40edce74-e548-4b8a-a63b-985455c0440a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:31.127246 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40edce74-e548-4b8a-a63b-985455c0440a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:31.128009 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40edce74-e548-4b8a-a63b-985455c0440a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:31.128473 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40edce74-e548-4b8a-a63b-985455c0440a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:31.130916 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40edce74-e548-4b8a-a63b-985455c0440a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:31.347955 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-40edce74-e548-4b8a-a63b-985455c0440a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:31.361775 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-40edce74-e548-4b8a-a63b-985455c0440a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.259330 Sep 13 06:40:31.362879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 181/354] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:31 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:31.448752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1653132440", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ea4fb14-b1a8-4860-a583-c1a571d4625e"}], "security_groups": [{"name": "tempest-securitygroup--1010515130"}], "key_name": "tempest-keypair-635113787", "user_data": "}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:31.472778 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:31.651396 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] validate_networks() for [('8ea4fb14-b1a8-4860-a583-c1a571d4625e', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:40:31.992734 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=42 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:32.391993 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ce7b0703-c06c-4126-b7ff-d382910af27c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:32.393294 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ce7b0703-c06c-4126-b7ff-d382910af27c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:32.408416 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce7b0703-c06c-4126-b7ff-d382910af27c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:32.409392 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce7b0703-c06c-4126-b7ff-d382910af27c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:32.410555 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce7b0703-c06c-4126-b7ff-d382910af27c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:32.412312 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce7b0703-c06c-4126-b7ff-d382910af27c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:32.413537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce7b0703-c06c-4126-b7ff-d382910af27c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:32.414398 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce7b0703-c06c-4126-b7ff-d382910af27c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:32.480948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:40:32.482124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:40:32.483373 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:40:32.484033 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:40:32.484677 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:40:32.497190 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:32.497782 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:32.498333 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:32.499158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:32.499740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:32.500257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:32.519286 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Getting quotas for project 2a2a801692c84c34b713aca165f69761. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:40:32.523807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Getting quotas for user 3a0a80a54cdc4107a508ca480b992319 and project 2a2a801692c84c34b713aca165f69761. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:40:32.536808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:40:32.539242 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:40:32.617907 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d6762d65-96ba-44f3-9902-438cc6ab4419 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.174474 Sep 13 06:40:32.619807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 174/355] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:40:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:40:32.635664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2bab2cb5-352b-45ae-9f1d-716c41600173 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:32.637899 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2bab2cb5-352b-45ae-9f1d-716c41600173 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:32.740548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ce7b0703-c06c-4126-b7ff-d382910af27c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:32.750284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ce7b0703-c06c-4126-b7ff-d382910af27c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.365277 Sep 13 06:40:32.771120 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 182/356] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:32 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:33.034244 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2bab2cb5-352b-45ae-9f1d-716c41600173 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:33.042568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2bab2cb5-352b-45ae-9f1d-716c41600173 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1245 microversion: 2.1 time: 0.415381 Sep 13 06:40:33.058380 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 175/357] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:32 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1245 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:33.776330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-739f0cd1-4111-491a-9e70-103bad555d67 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:33.778801 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-739f0cd1-4111-491a-9e70-103bad555d67 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:33.787001 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-739f0cd1-4111-491a-9e70-103bad555d67 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:33.790608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-739f0cd1-4111-491a-9e70-103bad555d67 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:33.791301 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-739f0cd1-4111-491a-9e70-103bad555d67 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:33.792832 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-739f0cd1-4111-491a-9e70-103bad555d67 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:33.793457 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-739f0cd1-4111-491a-9e70-103bad555d67 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:33.807937 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-739f0cd1-4111-491a-9e70-103bad555d67 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:34.069450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-03597f11-d0e8-41aa-b20b-3919fb7fd289 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:34.070874 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-03597f11-d0e8-41aa-b20b-3919fb7fd289 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:34.090912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-03597f11-d0e8-41aa-b20b-3919fb7fd289 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:34.091632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-03597f11-d0e8-41aa-b20b-3919fb7fd289 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:34.092088 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-03597f11-d0e8-41aa-b20b-3919fb7fd289 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:34.092843 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-03597f11-d0e8-41aa-b20b-3919fb7fd289 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:34.093314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-03597f11-d0e8-41aa-b20b-3919fb7fd289 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:34.102622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-03597f11-d0e8-41aa-b20b-3919fb7fd289 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:34.196402 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-739f0cd1-4111-491a-9e70-103bad555d67 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:34.208926 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-739f0cd1-4111-491a-9e70-103bad555d67 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.437380 Sep 13 06:40:34.209864 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-03597f11-d0e8-41aa-b20b-3919fb7fd289 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:34.210019 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 183/358] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:33 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:34.218951 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-03597f11-d0e8-41aa-b20b-3919fb7fd289 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1297 microversion: 2.1 time: 0.154109 Sep 13 06:40:34.223035 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 176/359] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:34 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1297 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:34.532962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8b2921e3-ce87-4372-a511-7ead8805f3b0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Action: 'create', calling method: .version_select at 0x7fdc0d8c7550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-458133748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCy0Q59JJeR5MaQDeRyLaNU3yfkj6MwIeL/o1kRKgM7bI3pgFlvTlwlLLlA7Mq2denUhagn79Kv3Q3b+gd6mTpbFO6r5p2Pzqf33VerWUQhYOkfRi0zVx64di+2J8o++fg=="}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:34.548437 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-8b2921e3-ce87-4372-a511-7ead8805f3b0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Getting quotas for project c53592d2364242099cedd8580f6af40d. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:40:34.552369 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-8b2921e3-ce87-4372-a511-7ead8805f3b0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Getting quotas for user 48d416e061ed4cba9862d0ddab3672d8 and project c53592d2364242099cedd8580f6af40d. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:40:34.573540 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8b2921e3-ce87-4372-a511-7ead8805f3b0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044383 Sep 13 06:40:34.574128 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 184/360] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Sep 13 06:40:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:40:34.685002 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1601625654", "imageRef": "3f09ceda-4c88-4c2f-82d2-0f38ec2c814c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-458133748", "networks": [{"uuid": "f4bb5795-20bb-4c67-8716-e6a4b026576f"}]}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:34.737417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] validate_networks() for [('f4bb5795-20bb-4c67-8716-e6a4b026576f', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:40:35.233427 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:40:35.234122 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bf5980c2-49c4-4f46-9459-7d60d9511fb0 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:35.234683 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:40:35.234944 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-bf5980c2-49c4-4f46-9459-7d60d9511fb0 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:35.235164 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:40:35.235676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:40:35.236102 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:40:35.242167 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bf5980c2-49c4-4f46-9459-7d60d9511fb0 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:35.242677 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bf5980c2-49c4-4f46-9459-7d60d9511fb0 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:35.243102 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bf5980c2-49c4-4f46-9459-7d60d9511fb0 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:35.244074 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bf5980c2-49c4-4f46-9459-7d60d9511fb0 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:35.244641 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bf5980c2-49c4-4f46-9459-7d60d9511fb0 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:35.245066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bf5980c2-49c4-4f46-9459-7d60d9511fb0 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:35.249569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:35.250061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:35.250646 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:35.251535 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:35.252097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:35.252568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:35.269721 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Getting quotas for project c53592d2364242099cedd8580f6af40d. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:40:35.273538 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Getting quotas for user 48d416e061ed4cba9862d0ddab3672d8 and project c53592d2364242099cedd8580f6af40d. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:40:35.285366 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:40:35.287480 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f09ceda-4c88-4c2f-82d2-0f38ec2c814c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:40:35.340673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-da9fe792-a6e2-429d-8869-713e726efd3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659532 Sep 13 06:40:35.342208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 177/361] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:40:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:40:35.347674 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-491b52f7-7884-437d-b0e6-6aa9637879b1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:35.348501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-491b52f7-7884-437d-b0e6-6aa9637879b1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:35.357247 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-491b52f7-7884-437d-b0e6-6aa9637879b1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:35.357907 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-491b52f7-7884-437d-b0e6-6aa9637879b1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:35.358504 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-491b52f7-7884-437d-b0e6-6aa9637879b1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:35.359671 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-491b52f7-7884-437d-b0e6-6aa9637879b1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:35.360286 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-491b52f7-7884-437d-b0e6-6aa9637879b1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:35.361037 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-491b52f7-7884-437d-b0e6-6aa9637879b1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:35.448041 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-491b52f7-7884-437d-b0e6-6aa9637879b1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:35.449760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-bf5980c2-49c4-4f46-9459-7d60d9511fb0 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:35.462352 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-491b52f7-7884-437d-b0e6-6aa9637879b1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1303 microversion: 2.1 time: 0.118725 Sep 13 06:40:35.463444 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-bf5980c2-49c4-4f46-9459-7d60d9511fb0 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.232960 Sep 13 06:40:35.463967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 178/362] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:35 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:35.469392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d1334407-2a9a-45d9-97e6-ca374a780f1f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:35.470307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d1334407-2a9a-45d9-97e6-ca374a780f1f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:35.479258 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 185/363] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:35 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:35.558863 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-d1334407-2a9a-45d9-97e6-ca374a780f1f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:35.567930 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d1334407-2a9a-45d9-97e6-ca374a780f1f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1258 microversion: 2.1 time: 0.102068 Sep 13 06:40:35.568696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 179/364] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:35 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1258 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:36.489346 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a5fff07e-2b04-43a9-b8b0-264c08b22d56 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:36.489924 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3afa7df9-77ea-4f93-994b-d1a0d16f8d79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:36.490435 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3afa7df9-77ea-4f93-994b-d1a0d16f8d79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:36.491177 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a5fff07e-2b04-43a9-b8b0-264c08b22d56 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:36.498033 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3afa7df9-77ea-4f93-994b-d1a0d16f8d79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:36.498192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a5fff07e-2b04-43a9-b8b0-264c08b22d56 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:36.498549 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a5fff07e-2b04-43a9-b8b0-264c08b22d56 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:36.498652 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3afa7df9-77ea-4f93-994b-d1a0d16f8d79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:36.498988 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a5fff07e-2b04-43a9-b8b0-264c08b22d56 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:36.499190 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3afa7df9-77ea-4f93-994b-d1a0d16f8d79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:36.499720 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a5fff07e-2b04-43a9-b8b0-264c08b22d56 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:36.500055 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3afa7df9-77ea-4f93-994b-d1a0d16f8d79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:36.500157 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a5fff07e-2b04-43a9-b8b0-264c08b22d56 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:36.500584 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a5fff07e-2b04-43a9-b8b0-264c08b22d56 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:36.500690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3afa7df9-77ea-4f93-994b-d1a0d16f8d79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:36.501093 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3afa7df9-77ea-4f93-994b-d1a0d16f8d79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:36.716602 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3afa7df9-77ea-4f93-994b-d1a0d16f8d79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:36.724383 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3afa7df9-77ea-4f93-994b-d1a0d16f8d79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.238440 Sep 13 06:40:36.735391 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 180/365] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:36 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:36.747973 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-bf7dc534-0bb3-415f-bb91-69c94b5468dd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:36.749074 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-bf7dc534-0bb3-415f-bb91-69c94b5468dd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:36.755998 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bf7dc534-0bb3-415f-bb91-69c94b5468dd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:36.756578 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bf7dc534-0bb3-415f-bb91-69c94b5468dd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:36.757100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bf7dc534-0bb3-415f-bb91-69c94b5468dd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:36.758154 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bf7dc534-0bb3-415f-bb91-69c94b5468dd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:36.758763 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bf7dc534-0bb3-415f-bb91-69c94b5468dd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:36.759286 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bf7dc534-0bb3-415f-bb91-69c94b5468dd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:36.781126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a5fff07e-2b04-43a9-b8b0-264c08b22d56 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:36.789066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a5fff07e-2b04-43a9-b8b0-264c08b22d56 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.303429 Sep 13 06:40:36.790338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 186/366] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:36 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:36.838120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-bf7dc534-0bb3-415f-bb91-69c94b5468dd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:36.845668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-bf7dc534-0bb3-415f-bb91-69c94b5468dd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1254 microversion: 2.1 time: 0.109164 Sep 13 06:40:36.846348 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 181/367] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:36 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1254 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:37.006564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-f0009cd7-f3e9-432a-b3d2-70862e76529f req-1e7029ce-2c0a-45dd-ba2b-0a0332eb2d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2001137-a4ff-4946-bc5e-56f38c00f36e", "tag": "48d46bd9-6b3e-4011-86f2-51e97c672d79"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:37.016136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-f0009cd7-f3e9-432a-b3d2-70862e76529f req-1e7029ce-2c0a-45dd-ba2b-0a0332eb2d61 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:37.016601 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-f0009cd7-f3e9-432a-b3d2-70862e76529f req-1e7029ce-2c0a-45dd-ba2b-0a0332eb2d61 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:37.017016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-f0009cd7-f3e9-432a-b3d2-70862e76529f req-1e7029ce-2c0a-45dd-ba2b-0a0332eb2d61 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:37.028315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-f0009cd7-f3e9-432a-b3d2-70862e76529f req-1e7029ce-2c0a-45dd-ba2b-0a0332eb2d61 service nova] Creating event network-changed:48d46bd9-6b3e-4011-86f2-51e97c672d79 for instance d2001137-a4ff-4946-bc5e-56f38c00f36e on hv-cinder-85638 Sep 13 06:40:37.033225 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-f0009cd7-f3e9-432a-b3d2-70862e76529f req-1e7029ce-2c0a-45dd-ba2b-0a0332eb2d61 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030283 Sep 13 06:40:37.033886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 187/368] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:40:37.749852 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f298e2c8-5ee5-4292-b6d0-cf1ec96b0a59 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:37.750405 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f298e2c8-5ee5-4292-b6d0-cf1ec96b0a59 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:37.757797 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f298e2c8-5ee5-4292-b6d0-cf1ec96b0a59 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:37.758464 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f298e2c8-5ee5-4292-b6d0-cf1ec96b0a59 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:37.759222 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f298e2c8-5ee5-4292-b6d0-cf1ec96b0a59 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:37.760719 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f298e2c8-5ee5-4292-b6d0-cf1ec96b0a59 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:37.761187 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f298e2c8-5ee5-4292-b6d0-cf1ec96b0a59 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:37.761616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f298e2c8-5ee5-4292-b6d0-cf1ec96b0a59 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:37.815478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-eb18457b-d955-4b92-94e9-2d8d6473a447 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:37.816743 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-eb18457b-d955-4b92-94e9-2d8d6473a447 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:37.824656 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb18457b-d955-4b92-94e9-2d8d6473a447 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:37.825330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb18457b-d955-4b92-94e9-2d8d6473a447 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:37.825955 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb18457b-d955-4b92-94e9-2d8d6473a447 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:37.826648 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb18457b-d955-4b92-94e9-2d8d6473a447 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:37.827256 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb18457b-d955-4b92-94e9-2d8d6473a447 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:37.827851 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb18457b-d955-4b92-94e9-2d8d6473a447 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:37.991882 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-eb18457b-d955-4b92-94e9-2d8d6473a447 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:37.995043 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:37.997812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f298e2c8-5ee5-4292-b6d0-cf1ec96b0a59 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:38.001824 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-eb18457b-d955-4b92-94e9-2d8d6473a447 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.191979 Sep 13 06:40:38.002399 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 188/369] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:37 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:38.005444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f298e2c8-5ee5-4292-b6d0-cf1ec96b0a59 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.262156 Sep 13 06:40:38.006007 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 182/370] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:37 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:38.015041 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-11b58bc0-3a2f-4a9a-9876-1c9d9aeb5d95 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:38.015851 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-11b58bc0-3a2f-4a9a-9876-1c9d9aeb5d95 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:38.022694 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11b58bc0-3a2f-4a9a-9876-1c9d9aeb5d95 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:38.023168 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11b58bc0-3a2f-4a9a-9876-1c9d9aeb5d95 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:38.023631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11b58bc0-3a2f-4a9a-9876-1c9d9aeb5d95 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:38.024312 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11b58bc0-3a2f-4a9a-9876-1c9d9aeb5d95 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:38.024761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11b58bc0-3a2f-4a9a-9876-1c9d9aeb5d95 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:38.025199 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11b58bc0-3a2f-4a9a-9876-1c9d9aeb5d95 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:38.087331 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-11b58bc0-3a2f-4a9a-9876-1c9d9aeb5d95 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:38.094720 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-11b58bc0-3a2f-4a9a-9876-1c9d9aeb5d95 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1310 microversion: 2.1 time: 0.083331 Sep 13 06:40:38.095273 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 189/371] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:38 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:39.028124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4fa5dcdc-a71d-4833-947f-5b374ea88f4b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:39.029631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4c094a58-fc04-4e24-b257-bbea0380f138 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:39.030459 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4fa5dcdc-a71d-4833-947f-5b374ea88f4b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:39.031086 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4c094a58-fc04-4e24-b257-bbea0380f138 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:39.043556 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fa5dcdc-a71d-4833-947f-5b374ea88f4b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:39.044580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c094a58-fc04-4e24-b257-bbea0380f138 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:39.044837 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fa5dcdc-a71d-4833-947f-5b374ea88f4b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:39.045837 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fa5dcdc-a71d-4833-947f-5b374ea88f4b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:39.047190 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c094a58-fc04-4e24-b257-bbea0380f138 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:39.049018 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c094a58-fc04-4e24-b257-bbea0380f138 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:39.053064 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c094a58-fc04-4e24-b257-bbea0380f138 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:39.054049 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c094a58-fc04-4e24-b257-bbea0380f138 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:39.054245 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fa5dcdc-a71d-4833-947f-5b374ea88f4b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:39.056509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4c094a58-fc04-4e24-b257-bbea0380f138 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:39.066194 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fa5dcdc-a71d-4833-947f-5b374ea88f4b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:39.067914 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fa5dcdc-a71d-4833-947f-5b374ea88f4b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:39.235502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4fa5dcdc-a71d-4833-947f-5b374ea88f4b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:39.245837 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4fa5dcdc-a71d-4833-947f-5b374ea88f4b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.224369 Sep 13 06:40:39.247314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 183/372] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:39 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:39.252621 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4686e0b9-7bc8-420b-a223-c5d21efa6bc7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:39.253226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4686e0b9-7bc8-420b-a223-c5d21efa6bc7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:39.260831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4686e0b9-7bc8-420b-a223-c5d21efa6bc7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:39.261523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4686e0b9-7bc8-420b-a223-c5d21efa6bc7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:39.262124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4686e0b9-7bc8-420b-a223-c5d21efa6bc7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:39.263054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4686e0b9-7bc8-420b-a223-c5d21efa6bc7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:39.263690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4686e0b9-7bc8-420b-a223-c5d21efa6bc7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:39.264552 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4686e0b9-7bc8-420b-a223-c5d21efa6bc7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:39.290560 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4c094a58-fc04-4e24-b257-bbea0380f138 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:39.300736 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4c094a58-fc04-4e24-b257-bbea0380f138 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.276335 Sep 13 06:40:39.301363 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 190/373] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:39 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:39.408528 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4686e0b9-7bc8-420b-a223-c5d21efa6bc7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:39.416585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4686e0b9-7bc8-420b-a223-c5d21efa6bc7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.168265 Sep 13 06:40:39.419996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 184/374] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:39 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:40.269673 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2af7129b-eb09-47c0-8b24-3ae2bdaf9dab tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:40.270281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2af7129b-eb09-47c0-8b24-3ae2bdaf9dab tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:40.276589 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2af7129b-eb09-47c0-8b24-3ae2bdaf9dab tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:40.277085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2af7129b-eb09-47c0-8b24-3ae2bdaf9dab tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:40.277508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2af7129b-eb09-47c0-8b24-3ae2bdaf9dab tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:40.278197 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2af7129b-eb09-47c0-8b24-3ae2bdaf9dab tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:40.278650 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2af7129b-eb09-47c0-8b24-3ae2bdaf9dab tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:40.279069 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2af7129b-eb09-47c0-8b24-3ae2bdaf9dab tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:40.328045 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-762448fc-7a70-425c-989c-8dad98a5778d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:40.328763 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-762448fc-7a70-425c-989c-8dad98a5778d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:40.335289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-762448fc-7a70-425c-989c-8dad98a5778d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:40.336213 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-762448fc-7a70-425c-989c-8dad98a5778d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:40.337386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-762448fc-7a70-425c-989c-8dad98a5778d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:40.339193 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-762448fc-7a70-425c-989c-8dad98a5778d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:40.340133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-762448fc-7a70-425c-989c-8dad98a5778d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:40.340813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-762448fc-7a70-425c-989c-8dad98a5778d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:40.427673 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2af7129b-eb09-47c0-8b24-3ae2bdaf9dab tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:40.435717 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2af7129b-eb09-47c0-8b24-3ae2bdaf9dab tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.169898 Sep 13 06:40:40.448326 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 191/375] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:40 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:40.459580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d8b0cc97-fcfa-4c41-94d3-594b8dc50257 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:40.460380 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d8b0cc97-fcfa-4c41-94d3-594b8dc50257 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:40.467070 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8b0cc97-fcfa-4c41-94d3-594b8dc50257 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:40.467677 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8b0cc97-fcfa-4c41-94d3-594b8dc50257 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:40.468115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8b0cc97-fcfa-4c41-94d3-594b8dc50257 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:40.468810 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8b0cc97-fcfa-4c41-94d3-594b8dc50257 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:40.469432 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8b0cc97-fcfa-4c41-94d3-594b8dc50257 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:40.469883 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8b0cc97-fcfa-4c41-94d3-594b8dc50257 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:40.488937 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-762448fc-7a70-425c-989c-8dad98a5778d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:40.498754 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-762448fc-7a70-425c-989c-8dad98a5778d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.177873 Sep 13 06:40:40.499393 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 185/376] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:40 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:40.608051 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d8b0cc97-fcfa-4c41-94d3-594b8dc50257 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:40.615650 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d8b0cc97-fcfa-4c41-94d3-594b8dc50257 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.164659 Sep 13 06:40:40.616295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 192/377] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:40 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:41.463915 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-801e9067-9082-46f4-9b4d-47f03f44832c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:41.465181 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-801e9067-9082-46f4-9b4d-47f03f44832c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:41.473017 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-801e9067-9082-46f4-9b4d-47f03f44832c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:41.473762 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-801e9067-9082-46f4-9b4d-47f03f44832c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:41.474389 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-801e9067-9082-46f4-9b4d-47f03f44832c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:41.475499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-801e9067-9082-46f4-9b4d-47f03f44832c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:41.476151 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-801e9067-9082-46f4-9b4d-47f03f44832c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:41.476989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-801e9067-9082-46f4-9b4d-47f03f44832c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:41.523295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-17182364-ca92-40c2-8f57-46b7438b211c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:41.524565 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-17182364-ca92-40c2-8f57-46b7438b211c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:41.531099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17182364-ca92-40c2-8f57-46b7438b211c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:41.531806 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17182364-ca92-40c2-8f57-46b7438b211c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:41.532411 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17182364-ca92-40c2-8f57-46b7438b211c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:41.533111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17182364-ca92-40c2-8f57-46b7438b211c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:41.533566 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17182364-ca92-40c2-8f57-46b7438b211c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:41.533984 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17182364-ca92-40c2-8f57-46b7438b211c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:41.702242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-17182364-ca92-40c2-8f57-46b7438b211c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:41.712532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-17182364-ca92-40c2-8f57-46b7438b211c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.192332 Sep 13 06:40:41.713482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 193/378] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:41 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:41.718469 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ae19fdb2-7cbe-46f2-b29f-ca5d0be35ffa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:41.719005 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ae19fdb2-7cbe-46f2-b29f-ca5d0be35ffa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:41.719243 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-801e9067-9082-46f4-9b4d-47f03f44832c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:41.725562 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae19fdb2-7cbe-46f2-b29f-ca5d0be35ffa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:41.726055 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae19fdb2-7cbe-46f2-b29f-ca5d0be35ffa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:41.726668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae19fdb2-7cbe-46f2-b29f-ca5d0be35ffa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:41.726828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-801e9067-9082-46f4-9b4d-47f03f44832c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.267101 Sep 13 06:40:41.727708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae19fdb2-7cbe-46f2-b29f-ca5d0be35ffa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:41.728210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae19fdb2-7cbe-46f2-b29f-ca5d0be35ffa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:41.728791 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae19fdb2-7cbe-46f2-b29f-ca5d0be35ffa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:41.756548 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 186/379] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:41 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:41.939165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ae19fdb2-7cbe-46f2-b29f-ca5d0be35ffa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:41.950831 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ae19fdb2-7cbe-46f2-b29f-ca5d0be35ffa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.236139 Sep 13 06:40:41.951428 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 194/380] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:41 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:42.741983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-53232590-1197-4ffb-84db-d32d075a7d3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:42.743313 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-53232590-1197-4ffb-84db-d32d075a7d3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:42.756488 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-142e9113-24f4-48f6-afed-f2d54a7b0935 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:42.757764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-142e9113-24f4-48f6-afed-f2d54a7b0935 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:42.764188 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-142e9113-24f4-48f6-afed-f2d54a7b0935 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:42.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53232590-1197-4ffb-84db-d32d075a7d3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:42.766004 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53232590-1197-4ffb-84db-d32d075a7d3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:42.766505 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53232590-1197-4ffb-84db-d32d075a7d3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:42.767313 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53232590-1197-4ffb-84db-d32d075a7d3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:42.767798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53232590-1197-4ffb-84db-d32d075a7d3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:42.768218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53232590-1197-4ffb-84db-d32d075a7d3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:42.772774 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-142e9113-24f4-48f6-afed-f2d54a7b0935 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:42.773461 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-142e9113-24f4-48f6-afed-f2d54a7b0935 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:42.775017 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-142e9113-24f4-48f6-afed-f2d54a7b0935 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:42.775506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-142e9113-24f4-48f6-afed-f2d54a7b0935 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:42.775929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-142e9113-24f4-48f6-afed-f2d54a7b0935 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:42.980331 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-53232590-1197-4ffb-84db-d32d075a7d3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:42.994435 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-53232590-1197-4ffb-84db-d32d075a7d3c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.258042 Sep 13 06:40:42.996327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 187/381] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:42 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:43.003862 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0eaa7335-332c-4e4b-8ed9-89940ce3272b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:43.004885 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0eaa7335-332c-4e4b-8ed9-89940ce3272b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:43.013594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-142e9113-24f4-48f6-afed-f2d54a7b0935 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:43.013740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0eaa7335-332c-4e4b-8ed9-89940ce3272b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:43.014143 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0eaa7335-332c-4e4b-8ed9-89940ce3272b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:43.014607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0eaa7335-332c-4e4b-8ed9-89940ce3272b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:43.015690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0eaa7335-332c-4e4b-8ed9-89940ce3272b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:43.016150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0eaa7335-332c-4e4b-8ed9-89940ce3272b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:43.017068 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0eaa7335-332c-4e4b-8ed9-89940ce3272b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:43.021262 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-142e9113-24f4-48f6-afed-f2d54a7b0935 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.268944 Sep 13 06:40:43.021832 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 195/382] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:42 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:43.209289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0eaa7335-332c-4e4b-8ed9-89940ce3272b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:43.220861 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0eaa7335-332c-4e4b-8ed9-89940ce3272b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.222999 Sep 13 06:40:43.222260 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 188/383] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:42 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:43.488788 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-efa02fd1-c1b7-4619-868c-afa314396e29 req-d47afa41-e1c1-43a3-9d99-24824da0aa34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462ba976-b35b-433e-b247-03eaef8428a5", "name": "network-vif-plugged", "status": "completed", "tag": "15fd17c0-6cb3-46dd-adc1-2ec4c2d2560d"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:43.509700 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-efa02fd1-c1b7-4619-868c-afa314396e29 req-d47afa41-e1c1-43a3-9d99-24824da0aa34 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:43.510819 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-efa02fd1-c1b7-4619-868c-afa314396e29 req-d47afa41-e1c1-43a3-9d99-24824da0aa34 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:43.511255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-efa02fd1-c1b7-4619-868c-afa314396e29 req-d47afa41-e1c1-43a3-9d99-24824da0aa34 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:43.541928 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-efa02fd1-c1b7-4619-868c-afa314396e29 req-d47afa41-e1c1-43a3-9d99-24824da0aa34 service nova] Creating event network-vif-plugged:15fd17c0-6cb3-46dd-adc1-2ec4c2d2560d for instance 462ba976-b35b-433e-b247-03eaef8428a5 on hv-cinder-85638 Sep 13 06:40:43.553082 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-efa02fd1-c1b7-4619-868c-afa314396e29 req-d47afa41-e1c1-43a3-9d99-24824da0aa34 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073397 Sep 13 06:40:43.553664 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 196/384] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:40:44.021009 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e8256a9d-f723-4d8e-ad5b-d726da6833e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:44.021731 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e8256a9d-f723-4d8e-ad5b-d726da6833e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:44.029027 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8256a9d-f723-4d8e-ad5b-d726da6833e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:44.029632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8256a9d-f723-4d8e-ad5b-d726da6833e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:44.030179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8256a9d-f723-4d8e-ad5b-d726da6833e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:44.031006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8256a9d-f723-4d8e-ad5b-d726da6833e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:44.031805 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8256a9d-f723-4d8e-ad5b-d726da6833e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:44.032523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8256a9d-f723-4d8e-ad5b-d726da6833e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:44.048921 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2f7cb752-ecd5-42c0-b3bf-551aaab5f13d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:44.050225 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2f7cb752-ecd5-42c0-b3bf-551aaab5f13d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:44.061411 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2f7cb752-ecd5-42c0-b3bf-551aaab5f13d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:44.063397 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2f7cb752-ecd5-42c0-b3bf-551aaab5f13d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:44.066039 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2f7cb752-ecd5-42c0-b3bf-551aaab5f13d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:44.066967 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2f7cb752-ecd5-42c0-b3bf-551aaab5f13d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:44.067623 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2f7cb752-ecd5-42c0-b3bf-551aaab5f13d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:44.068198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2f7cb752-ecd5-42c0-b3bf-551aaab5f13d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:44.235422 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2f7cb752-ecd5-42c0-b3bf-551aaab5f13d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:44.244760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2f7cb752-ecd5-42c0-b3bf-551aaab5f13d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.199909 Sep 13 06:40:44.245339 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 197/385] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:44 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:44.252164 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-74ed8a1c-2517-443d-98cc-d612cec93109 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:44.253155 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-74ed8a1c-2517-443d-98cc-d612cec93109 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:44.260458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74ed8a1c-2517-443d-98cc-d612cec93109 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:44.261212 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74ed8a1c-2517-443d-98cc-d612cec93109 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:44.261877 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74ed8a1c-2517-443d-98cc-d612cec93109 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:44.262776 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74ed8a1c-2517-443d-98cc-d612cec93109 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:44.263975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74ed8a1c-2517-443d-98cc-d612cec93109 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:44.264634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74ed8a1c-2517-443d-98cc-d612cec93109 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:44.279201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e8256a9d-f723-4d8e-ad5b-d726da6833e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:44.287139 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e8256a9d-f723-4d8e-ad5b-d726da6833e4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.270064 Sep 13 06:40:44.292173 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 189/386] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:44 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:44.509782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-74ed8a1c-2517-443d-98cc-d612cec93109 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:44.518416 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-74ed8a1c-2517-443d-98cc-d612cec93109 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.272038 Sep 13 06:40:44.529035 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 198/387] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:44 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:45.268228 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-53cec242-99fd-40b8-a3a2-d8cd43bb3ad4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:45.268851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-53cec242-99fd-40b8-a3a2-d8cd43bb3ad4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:45.271153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=4 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:45.276591 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53cec242-99fd-40b8-a3a2-d8cd43bb3ad4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:45.277123 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53cec242-99fd-40b8-a3a2-d8cd43bb3ad4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:45.277529 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53cec242-99fd-40b8-a3a2-d8cd43bb3ad4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:45.278238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53cec242-99fd-40b8-a3a2-d8cd43bb3ad4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:45.278686 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53cec242-99fd-40b8-a3a2-d8cd43bb3ad4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:45.279111 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53cec242-99fd-40b8-a3a2-d8cd43bb3ad4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:45.320311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e3852bb0-8f1a-4831-9a7d-f305b4919c92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:45.321045 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e3852bb0-8f1a-4831-9a7d-f305b4919c92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:45.323813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=14 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:45.335302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3852bb0-8f1a-4831-9a7d-f305b4919c92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:45.336182 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3852bb0-8f1a-4831-9a7d-f305b4919c92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:45.336906 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3852bb0-8f1a-4831-9a7d-f305b4919c92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:45.338447 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3852bb0-8f1a-4831-9a7d-f305b4919c92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:45.339325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3852bb0-8f1a-4831-9a7d-f305b4919c92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:45.340507 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3852bb0-8f1a-4831-9a7d-f305b4919c92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:45.485587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-53cec242-99fd-40b8-a3a2-d8cd43bb3ad4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:45.495625 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-53cec242-99fd-40b8-a3a2-d8cd43bb3ad4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.231914 Sep 13 06:40:45.496364 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 190/388] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:45 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:45.544367 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0abcc49f-0fca-4464-b406-b2855860750d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:45.545266 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0abcc49f-0fca-4464-b406-b2855860750d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:45.552996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abcc49f-0fca-4464-b406-b2855860750d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:45.553672 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abcc49f-0fca-4464-b406-b2855860750d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:45.554295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abcc49f-0fca-4464-b406-b2855860750d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:45.555180 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abcc49f-0fca-4464-b406-b2855860750d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:45.555846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abcc49f-0fca-4464-b406-b2855860750d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:45.556472 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abcc49f-0fca-4464-b406-b2855860750d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:45.562046 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:45.563443 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e3852bb0-8f1a-4831-9a7d-f305b4919c92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:45.573189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e3852bb0-8f1a-4831-9a7d-f305b4919c92 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.257319 Sep 13 06:40:45.588584 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 199/389] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:45 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:45.590475 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=16 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:45.750503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0abcc49f-0fca-4464-b406-b2855860750d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:45.760633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0abcc49f-0fca-4464-b406-b2855860750d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.222233 Sep 13 06:40:45.761723 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 191/390] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:45 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:45.777080 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-a813b396-b340-49ff-9413-f1fb8476a222 req-8674ed10-dc99-457c-9d33-52af0a605f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2001137-a4ff-4946-bc5e-56f38c00f36e", "name": "network-vif-plugged", "status": "completed", "tag": "48d46bd9-6b3e-4011-86f2-51e97c672d79"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:45.807069 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-a813b396-b340-49ff-9413-f1fb8476a222 req-8674ed10-dc99-457c-9d33-52af0a605f7c service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:45.811677 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-a813b396-b340-49ff-9413-f1fb8476a222 req-8674ed10-dc99-457c-9d33-52af0a605f7c service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:45.812142 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-a813b396-b340-49ff-9413-f1fb8476a222 req-8674ed10-dc99-457c-9d33-52af0a605f7c service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:45.833901 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-a813b396-b340-49ff-9413-f1fb8476a222 req-8674ed10-dc99-457c-9d33-52af0a605f7c service nova] Creating event network-vif-plugged:48d46bd9-6b3e-4011-86f2-51e97c672d79 for instance d2001137-a4ff-4946-bc5e-56f38c00f36e on hv-cinder-85638 Sep 13 06:40:45.846591 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-a813b396-b340-49ff-9413-f1fb8476a222 req-8674ed10-dc99-457c-9d33-52af0a605f7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073905 Sep 13 06:40:45.848439 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 200/391] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:40:46.523702 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e28c5ce3-6f13-4f27-b249-09002c7e0d3f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:46.526456 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e28c5ce3-6f13-4f27-b249-09002c7e0d3f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:46.538245 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e28c5ce3-6f13-4f27-b249-09002c7e0d3f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:46.541469 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e28c5ce3-6f13-4f27-b249-09002c7e0d3f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:46.542538 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e28c5ce3-6f13-4f27-b249-09002c7e0d3f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:46.547631 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e28c5ce3-6f13-4f27-b249-09002c7e0d3f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:46.548333 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e28c5ce3-6f13-4f27-b249-09002c7e0d3f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:46.548973 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e28c5ce3-6f13-4f27-b249-09002c7e0d3f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:46.597816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-710e0d1e-52e7-4126-a84f-4e13721577c4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:46.598613 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-710e0d1e-52e7-4126-a84f-4e13721577c4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:46.608390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-710e0d1e-52e7-4126-a84f-4e13721577c4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:46.615780 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-710e0d1e-52e7-4126-a84f-4e13721577c4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:46.616503 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-710e0d1e-52e7-4126-a84f-4e13721577c4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:46.617301 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-710e0d1e-52e7-4126-a84f-4e13721577c4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:46.618247 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-710e0d1e-52e7-4126-a84f-4e13721577c4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:46.620104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-710e0d1e-52e7-4126-a84f-4e13721577c4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:46.707055 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e28c5ce3-6f13-4f27-b249-09002c7e0d3f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:46.716001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e28c5ce3-6f13-4f27-b249-09002c7e0d3f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.196598 Sep 13 06:40:46.717317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 192/392] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:46 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:46.780031 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-710e0d1e-52e7-4126-a84f-4e13721577c4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:46.788210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-710e0d1e-52e7-4126-a84f-4e13721577c4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.194996 Sep 13 06:40:46.789141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 201/393] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:46 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:46.793673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1f322040-eace-447c-a96c-dba4faff3be8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:46.794522 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1f322040-eace-447c-a96c-dba4faff3be8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:46.800958 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1f322040-eace-447c-a96c-dba4faff3be8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:46.801434 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1f322040-eace-447c-a96c-dba4faff3be8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:46.801895 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1f322040-eace-447c-a96c-dba4faff3be8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:46.802546 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1f322040-eace-447c-a96c-dba4faff3be8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:46.802996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1f322040-eace-447c-a96c-dba4faff3be8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:46.803445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1f322040-eace-447c-a96c-dba4faff3be8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:46.938701 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1f322040-eace-447c-a96c-dba4faff3be8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:46.946374 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1f322040-eace-447c-a96c-dba4faff3be8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.157854 Sep 13 06:40:46.947553 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 193/394] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:46 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:47.738805 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e3b5e999-4ffa-4c21-a169-7ddde8e6d6b3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:47.739480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e3b5e999-4ffa-4c21-a169-7ddde8e6d6b3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:47.745956 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3b5e999-4ffa-4c21-a169-7ddde8e6d6b3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:47.746507 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3b5e999-4ffa-4c21-a169-7ddde8e6d6b3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:47.747038 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3b5e999-4ffa-4c21-a169-7ddde8e6d6b3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:47.747813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3b5e999-4ffa-4c21-a169-7ddde8e6d6b3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:47.748482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3b5e999-4ffa-4c21-a169-7ddde8e6d6b3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:47.748995 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3b5e999-4ffa-4c21-a169-7ddde8e6d6b3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:47.819694 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-310a83d8-e668-48da-94b1-8c6f879407a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:47.825571 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-310a83d8-e668-48da-94b1-8c6f879407a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:47.831674 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-310a83d8-e668-48da-94b1-8c6f879407a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:47.832161 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-310a83d8-e668-48da-94b1-8c6f879407a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:47.832592 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-310a83d8-e668-48da-94b1-8c6f879407a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:47.833286 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-310a83d8-e668-48da-94b1-8c6f879407a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:47.833764 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-310a83d8-e668-48da-94b1-8c6f879407a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:47.834183 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-310a83d8-e668-48da-94b1-8c6f879407a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:47.923977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e3b5e999-4ffa-4c21-a169-7ddde8e6d6b3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:47.931922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e3b5e999-4ffa-4c21-a169-7ddde8e6d6b3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.197253 Sep 13 06:40:47.932493 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 202/395] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:47 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:47.971143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-492ba4e4-932e-4977-9908-a7a6796a3856 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:47.972176 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-492ba4e4-932e-4977-9908-a7a6796a3856 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:47.978970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-492ba4e4-932e-4977-9908-a7a6796a3856 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:47.979845 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-492ba4e4-932e-4977-9908-a7a6796a3856 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:47.980689 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-492ba4e4-932e-4977-9908-a7a6796a3856 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:47.981512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-492ba4e4-932e-4977-9908-a7a6796a3856 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:47.982142 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-492ba4e4-932e-4977-9908-a7a6796a3856 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:47.982725 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-492ba4e4-932e-4977-9908-a7a6796a3856 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:47.986438 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-310a83d8-e668-48da-94b1-8c6f879407a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:47.998165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-310a83d8-e668-48da-94b1-8c6f879407a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.189898 Sep 13 06:40:47.998666 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 194/396] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:47 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:48.119689 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-492ba4e4-932e-4977-9908-a7a6796a3856 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:48.129811 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-492ba4e4-932e-4977-9908-a7a6796a3856 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.163715 Sep 13 06:40:48.138499 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 203/397] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:47 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:48.958016 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9efd95b3-81ea-467a-910c-dcb373b4724a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:48.958597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9efd95b3-81ea-467a-910c-dcb373b4724a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:48.966763 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9efd95b3-81ea-467a-910c-dcb373b4724a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:48.967321 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9efd95b3-81ea-467a-910c-dcb373b4724a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:48.967784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9efd95b3-81ea-467a-910c-dcb373b4724a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:48.968494 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9efd95b3-81ea-467a-910c-dcb373b4724a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:48.968947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9efd95b3-81ea-467a-910c-dcb373b4724a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:48.969424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9efd95b3-81ea-467a-910c-dcb373b4724a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:49.021608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-db63300e-e6c9-4f69-a63e-a40c6702b8f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:49.022311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-db63300e-e6c9-4f69-a63e-a40c6702b8f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:49.028807 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db63300e-e6c9-4f69-a63e-a40c6702b8f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:49.029486 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db63300e-e6c9-4f69-a63e-a40c6702b8f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:49.030103 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db63300e-e6c9-4f69-a63e-a40c6702b8f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:49.030968 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db63300e-e6c9-4f69-a63e-a40c6702b8f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:49.031638 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db63300e-e6c9-4f69-a63e-a40c6702b8f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:49.032275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-db63300e-e6c9-4f69-a63e-a40c6702b8f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:49.136015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9efd95b3-81ea-467a-910c-dcb373b4724a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:49.143874 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9efd95b3-81ea-467a-910c-dcb373b4724a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.189708 Sep 13 06:40:49.144451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 195/398] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:48 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:49.154047 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ae62f95c-09e9-4e13-94e7-fcc6cca1d46a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:49.154740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ae62f95c-09e9-4e13-94e7-fcc6cca1d46a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:49.161493 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae62f95c-09e9-4e13-94e7-fcc6cca1d46a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:49.162061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae62f95c-09e9-4e13-94e7-fcc6cca1d46a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:49.162496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae62f95c-09e9-4e13-94e7-fcc6cca1d46a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:49.163188 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae62f95c-09e9-4e13-94e7-fcc6cca1d46a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:49.163706 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae62f95c-09e9-4e13-94e7-fcc6cca1d46a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:49.164135 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae62f95c-09e9-4e13-94e7-fcc6cca1d46a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:49.185632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-db63300e-e6c9-4f69-a63e-a40c6702b8f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:49.193302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-db63300e-e6c9-4f69-a63e-a40c6702b8f4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.175734 Sep 13 06:40:49.200111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 204/399] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:49 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:49.309544 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ae62f95c-09e9-4e13-94e7-fcc6cca1d46a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:49.317612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ae62f95c-09e9-4e13-94e7-fcc6cca1d46a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.167624 Sep 13 06:40:49.318183 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 196/400] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:49 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:50.167295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-71ebbebf-6479-44aa-a516-0385e295f673 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:50.168299 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-71ebbebf-6479-44aa-a516-0385e295f673 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:50.174532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71ebbebf-6479-44aa-a516-0385e295f673 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:50.175091 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71ebbebf-6479-44aa-a516-0385e295f673 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:50.175650 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71ebbebf-6479-44aa-a516-0385e295f673 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:50.176595 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71ebbebf-6479-44aa-a516-0385e295f673 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:50.177273 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71ebbebf-6479-44aa-a516-0385e295f673 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:50.178208 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71ebbebf-6479-44aa-a516-0385e295f673 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:50.216087 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-70822993-f01e-4136-a0e8-3d4707dc5ef0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:50.217509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-70822993-f01e-4136-a0e8-3d4707dc5ef0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:50.225487 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70822993-f01e-4136-a0e8-3d4707dc5ef0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:50.226365 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70822993-f01e-4136-a0e8-3d4707dc5ef0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:50.227339 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70822993-f01e-4136-a0e8-3d4707dc5ef0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:50.229236 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70822993-f01e-4136-a0e8-3d4707dc5ef0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:50.229932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70822993-f01e-4136-a0e8-3d4707dc5ef0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:50.230425 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70822993-f01e-4136-a0e8-3d4707dc5ef0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:50.332640 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-71ebbebf-6479-44aa-a516-0385e295f673 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:50.346416 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-71ebbebf-6479-44aa-a516-0385e295f673 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.183821 Sep 13 06:40:50.360199 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 205/401] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:50 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:50.368934 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d859cdf6-5e03-44bc-bcef-e81591ae588d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:50.370229 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d859cdf6-5e03-44bc-bcef-e81591ae588d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:50.376445 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d859cdf6-5e03-44bc-bcef-e81591ae588d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:50.377183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d859cdf6-5e03-44bc-bcef-e81591ae588d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:50.377770 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d859cdf6-5e03-44bc-bcef-e81591ae588d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:50.378059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-70822993-f01e-4136-a0e8-3d4707dc5ef0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:50.378815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d859cdf6-5e03-44bc-bcef-e81591ae588d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:50.379441 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d859cdf6-5e03-44bc-bcef-e81591ae588d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:50.380809 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d859cdf6-5e03-44bc-bcef-e81591ae588d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:50.387025 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-70822993-f01e-4136-a0e8-3d4707dc5ef0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.175014 Sep 13 06:40:50.387735 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 197/402] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:50 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:50.525058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d859cdf6-5e03-44bc-bcef-e81591ae588d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:50.527466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:50.534715 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d859cdf6-5e03-44bc-bcef-e81591ae588d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.173110 Sep 13 06:40:50.540946 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 206/403] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:50 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:51.372996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2e1571c8-e146-4c62-8cf5-9ea997446a7b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:51.373610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2e1571c8-e146-4c62-8cf5-9ea997446a7b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:51.379922 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2e1571c8-e146-4c62-8cf5-9ea997446a7b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:51.380405 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2e1571c8-e146-4c62-8cf5-9ea997446a7b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:51.380840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2e1571c8-e146-4c62-8cf5-9ea997446a7b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:51.381525 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2e1571c8-e146-4c62-8cf5-9ea997446a7b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:51.381984 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2e1571c8-e146-4c62-8cf5-9ea997446a7b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:51.382411 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2e1571c8-e146-4c62-8cf5-9ea997446a7b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:51.409927 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4ea63e0c-d73a-4364-b991-2bd47244a6a1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:51.410533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4ea63e0c-d73a-4364-b991-2bd47244a6a1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:51.416866 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4ea63e0c-d73a-4364-b991-2bd47244a6a1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:51.417346 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4ea63e0c-d73a-4364-b991-2bd47244a6a1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:51.417775 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4ea63e0c-d73a-4364-b991-2bd47244a6a1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:51.418464 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4ea63e0c-d73a-4364-b991-2bd47244a6a1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:51.418914 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4ea63e0c-d73a-4364-b991-2bd47244a6a1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:51.419341 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4ea63e0c-d73a-4364-b991-2bd47244a6a1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:51.522642 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2e1571c8-e146-4c62-8cf5-9ea997446a7b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:51.535062 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2e1571c8-e146-4c62-8cf5-9ea997446a7b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.166365 Sep 13 06:40:51.535887 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 198/404] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:51 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:51.551204 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4ea63e0c-d73a-4364-b991-2bd47244a6a1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:51.558769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3328f2c0-f71b-4913-89b1-467e68243a9e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:51.559684 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3328f2c0-f71b-4913-89b1-467e68243a9e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:51.564044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4ea63e0c-d73a-4364-b991-2bd47244a6a1 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.157856 Sep 13 06:40:51.564631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 207/405] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:51 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:51.565853 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3328f2c0-f71b-4913-89b1-467e68243a9e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:51.566350 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3328f2c0-f71b-4913-89b1-467e68243a9e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:51.567204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3328f2c0-f71b-4913-89b1-467e68243a9e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:51.568500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3328f2c0-f71b-4913-89b1-467e68243a9e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:51.569264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3328f2c0-f71b-4913-89b1-467e68243a9e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:51.569727 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3328f2c0-f71b-4913-89b1-467e68243a9e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:51.700879 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3328f2c0-f71b-4913-89b1-467e68243a9e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:51.708540 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3328f2c0-f71b-4913-89b1-467e68243a9e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.154329 Sep 13 06:40:51.709102 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 199/406] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:51 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:52.558705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-98bebc75-60b0-4508-a8c5-723681add85a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:52.559339 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-98bebc75-60b0-4508-a8c5-723681add85a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:52.565171 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98bebc75-60b0-4508-a8c5-723681add85a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:52.565652 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98bebc75-60b0-4508-a8c5-723681add85a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:52.566085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98bebc75-60b0-4508-a8c5-723681add85a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:52.566769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98bebc75-60b0-4508-a8c5-723681add85a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:52.567216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98bebc75-60b0-4508-a8c5-723681add85a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:52.567664 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98bebc75-60b0-4508-a8c5-723681add85a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:52.588685 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-372e8588-b0e2-4c66-bf19-512c616b064f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:52.588685 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-372e8588-b0e2-4c66-bf19-512c616b064f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:52.595247 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372e8588-b0e2-4c66-bf19-512c616b064f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:52.595768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372e8588-b0e2-4c66-bf19-512c616b064f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:52.596200 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372e8588-b0e2-4c66-bf19-512c616b064f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:52.596896 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372e8588-b0e2-4c66-bf19-512c616b064f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:52.597350 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372e8588-b0e2-4c66-bf19-512c616b064f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:52.597764 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-372e8588-b0e2-4c66-bf19-512c616b064f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:52.700284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-98bebc75-60b0-4508-a8c5-723681add85a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:52.707991 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-98bebc75-60b0-4508-a8c5-723681add85a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.153104 Sep 13 06:40:52.708661 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 208/407] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:52 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:52.727324 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-372e8588-b0e2-4c66-bf19-512c616b064f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:52.730270 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3e0da8dd-8979-48d7-83b0-7b8cb2b183b6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:52.730875 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3e0da8dd-8979-48d7-83b0-7b8cb2b183b6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:52.735597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-372e8588-b0e2-4c66-bf19-512c616b064f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.151878 Sep 13 06:40:52.736155 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 200/408] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:52 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:52.736924 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e0da8dd-8979-48d7-83b0-7b8cb2b183b6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:52.737265 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e0da8dd-8979-48d7-83b0-7b8cb2b183b6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:52.737698 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e0da8dd-8979-48d7-83b0-7b8cb2b183b6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:52.738388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e0da8dd-8979-48d7-83b0-7b8cb2b183b6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:52.739107 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e0da8dd-8979-48d7-83b0-7b8cb2b183b6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:52.739554 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e0da8dd-8979-48d7-83b0-7b8cb2b183b6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:52.872924 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3e0da8dd-8979-48d7-83b0-7b8cb2b183b6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:52.880570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3e0da8dd-8979-48d7-83b0-7b8cb2b183b6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.154523 Sep 13 06:40:52.881138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 209/409] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:52 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:53.731392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ba5aba3b-8476-42cb-af73-4c15f48f623f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:53.732015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ba5aba3b-8476-42cb-af73-4c15f48f623f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:53.738564 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba5aba3b-8476-42cb-af73-4c15f48f623f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:53.739054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba5aba3b-8476-42cb-af73-4c15f48f623f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:53.739518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba5aba3b-8476-42cb-af73-4c15f48f623f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:53.740221 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba5aba3b-8476-42cb-af73-4c15f48f623f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:53.740672 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba5aba3b-8476-42cb-af73-4c15f48f623f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:53.741090 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba5aba3b-8476-42cb-af73-4c15f48f623f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:53.758522 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-076b3808-7b4a-40e7-bc87-4488083a67b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:53.760369 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-076b3808-7b4a-40e7-bc87-4488083a67b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:53.767481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-076b3808-7b4a-40e7-bc87-4488083a67b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:53.768288 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-076b3808-7b4a-40e7-bc87-4488083a67b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:53.768878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-076b3808-7b4a-40e7-bc87-4488083a67b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:53.769826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-076b3808-7b4a-40e7-bc87-4488083a67b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:53.770506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-076b3808-7b4a-40e7-bc87-4488083a67b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:53.771171 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-076b3808-7b4a-40e7-bc87-4488083a67b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:53.914427 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ba5aba3b-8476-42cb-af73-4c15f48f623f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:53.924871 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ba5aba3b-8476-42cb-af73-4c15f48f623f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.197287 Sep 13 06:40:53.925617 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-076b3808-7b4a-40e7-bc87-4488083a67b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:53.941794 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 201/410] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:53 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:53.948739 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-076b3808-7b4a-40e7-bc87-4488083a67b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.194362 Sep 13 06:40:53.949319 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 210/411] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:53 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:53.949529 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ec04e8e6-1c77-4a28-b332-bfd6cc4125b4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:53.950136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ec04e8e6-1c77-4a28-b332-bfd6cc4125b4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:53.956358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec04e8e6-1c77-4a28-b332-bfd6cc4125b4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:53.956843 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec04e8e6-1c77-4a28-b332-bfd6cc4125b4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:53.957279 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec04e8e6-1c77-4a28-b332-bfd6cc4125b4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:53.957970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec04e8e6-1c77-4a28-b332-bfd6cc4125b4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:53.958427 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec04e8e6-1c77-4a28-b332-bfd6cc4125b4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:53.958850 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec04e8e6-1c77-4a28-b332-bfd6cc4125b4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:54.090600 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ec04e8e6-1c77-4a28-b332-bfd6cc4125b4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:54.098158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ec04e8e6-1c77-4a28-b332-bfd6cc4125b4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.154893 Sep 13 06:40:54.098686 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 202/412] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:53 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:54.953730 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-89fa3d8b-bfb1-4f48-a526-9b2bb82b140b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:54.954334 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-89fa3d8b-bfb1-4f48-a526-9b2bb82b140b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:54.960285 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89fa3d8b-bfb1-4f48-a526-9b2bb82b140b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:54.960758 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89fa3d8b-bfb1-4f48-a526-9b2bb82b140b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:54.961182 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89fa3d8b-bfb1-4f48-a526-9b2bb82b140b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:54.961876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89fa3d8b-bfb1-4f48-a526-9b2bb82b140b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:54.962321 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89fa3d8b-bfb1-4f48-a526-9b2bb82b140b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:54.962733 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89fa3d8b-bfb1-4f48-a526-9b2bb82b140b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:54.971334 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-218694b0-2e4d-4742-aa7a-3b7d667cf45d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:54.971994 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-218694b0-2e4d-4742-aa7a-3b7d667cf45d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:54.978362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-218694b0-2e4d-4742-aa7a-3b7d667cf45d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:54.978842 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-218694b0-2e4d-4742-aa7a-3b7d667cf45d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:54.979268 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-218694b0-2e4d-4742-aa7a-3b7d667cf45d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:54.979983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-218694b0-2e4d-4742-aa7a-3b7d667cf45d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:54.980432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-218694b0-2e4d-4742-aa7a-3b7d667cf45d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:54.980849 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-218694b0-2e4d-4742-aa7a-3b7d667cf45d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:55.107724 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-89fa3d8b-bfb1-4f48-a526-9b2bb82b140b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:55.116139 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-89fa3d8b-bfb1-4f48-a526-9b2bb82b140b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.165504 Sep 13 06:40:55.116139 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 211/413] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:54 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:55.119442 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-218694b0-2e4d-4742-aa7a-3b7d667cf45d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:55.121550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1038276c-dd09-40e7-9f63-1fa4e051d94d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:55.122227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1038276c-dd09-40e7-9f63-1fa4e051d94d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:55.127912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1038276c-dd09-40e7-9f63-1fa4e051d94d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:55.128387 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1038276c-dd09-40e7-9f63-1fa4e051d94d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:55.128797 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-218694b0-2e4d-4742-aa7a-3b7d667cf45d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.161200 Sep 13 06:40:55.128919 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1038276c-dd09-40e7-9f63-1fa4e051d94d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:55.135848 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 203/414] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:54 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:55.135986 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1038276c-dd09-40e7-9f63-1fa4e051d94d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:55.135986 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1038276c-dd09-40e7-9f63-1fa4e051d94d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:55.135986 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1038276c-dd09-40e7-9f63-1fa4e051d94d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:55.255614 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1038276c-dd09-40e7-9f63-1fa4e051d94d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:55.263626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1038276c-dd09-40e7-9f63-1fa4e051d94d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.146245 Sep 13 06:40:55.264206 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 212/415] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:55 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:56.139056 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0fb01f84-dfe8-448e-a61b-734f0c8c8d6f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:56.139692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0fb01f84-dfe8-448e-a61b-734f0c8c8d6f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:56.146118 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fb01f84-dfe8-448e-a61b-734f0c8c8d6f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:56.146595 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fb01f84-dfe8-448e-a61b-734f0c8c8d6f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:56.147048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fb01f84-dfe8-448e-a61b-734f0c8c8d6f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:56.147730 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fb01f84-dfe8-448e-a61b-734f0c8c8d6f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:56.148184 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fb01f84-dfe8-448e-a61b-734f0c8c8d6f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:56.148601 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fb01f84-dfe8-448e-a61b-734f0c8c8d6f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:56.152617 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-16811c79-1ee7-4a76-8e5b-b027c1bfd532 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:56.153222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-16811c79-1ee7-4a76-8e5b-b027c1bfd532 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:56.159130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16811c79-1ee7-4a76-8e5b-b027c1bfd532 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:56.159594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16811c79-1ee7-4a76-8e5b-b027c1bfd532 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:56.160024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16811c79-1ee7-4a76-8e5b-b027c1bfd532 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:56.160713 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16811c79-1ee7-4a76-8e5b-b027c1bfd532 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:56.161196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16811c79-1ee7-4a76-8e5b-b027c1bfd532 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:56.161615 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-16811c79-1ee7-4a76-8e5b-b027c1bfd532 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:56.288736 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0fb01f84-dfe8-448e-a61b-734f0c8c8d6f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:56.291294 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-16811c79-1ee7-4a76-8e5b-b027c1bfd532 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:56.298824 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0fb01f84-dfe8-448e-a61b-734f0c8c8d6f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.163492 Sep 13 06:40:56.298996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-16811c79-1ee7-4a76-8e5b-b027c1bfd532 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.150621 Sep 13 06:40:56.299666 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 204/417] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:56 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:56.299800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 213/417] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:56 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:56.303856 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-cde762c8-dc88-4393-be6f-7b1927edc734 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:56.304451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-cde762c8-dc88-4393-be6f-7b1927edc734 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:56.310105 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cde762c8-dc88-4393-be6f-7b1927edc734 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:56.310582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cde762c8-dc88-4393-be6f-7b1927edc734 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:56.311004 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cde762c8-dc88-4393-be6f-7b1927edc734 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:56.311712 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cde762c8-dc88-4393-be6f-7b1927edc734 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:56.312165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cde762c8-dc88-4393-be6f-7b1927edc734 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:56.312582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cde762c8-dc88-4393-be6f-7b1927edc734 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:56.438873 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-cde762c8-dc88-4393-be6f-7b1927edc734 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:56.447040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-cde762c8-dc88-4393-be6f-7b1927edc734 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.146115 Sep 13 06:40:56.447639 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 205/418] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:56 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:57.321099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6f697f7b-c475-4572-84a3-bfd81891c8f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:57.321649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6f697f7b-c475-4572-84a3-bfd81891c8f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:57.323457 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:57.326215 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-950a1645-bff4-4c0d-9fe3-ce8159cee9b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:57.326822 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-950a1645-bff4-4c0d-9fe3-ce8159cee9b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:57.328329 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f697f7b-c475-4572-84a3-bfd81891c8f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:57.328812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f697f7b-c475-4572-84a3-bfd81891c8f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:57.329244 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f697f7b-c475-4572-84a3-bfd81891c8f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:57.329936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f697f7b-c475-4572-84a3-bfd81891c8f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:57.330387 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f697f7b-c475-4572-84a3-bfd81891c8f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:57.330809 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f697f7b-c475-4572-84a3-bfd81891c8f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:57.332816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-950a1645-bff4-4c0d-9fe3-ce8159cee9b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:57.333301 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-950a1645-bff4-4c0d-9fe3-ce8159cee9b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:57.333734 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-950a1645-bff4-4c0d-9fe3-ce8159cee9b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:57.334710 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-950a1645-bff4-4c0d-9fe3-ce8159cee9b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:57.335289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-950a1645-bff4-4c0d-9fe3-ce8159cee9b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:57.335740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-950a1645-bff4-4c0d-9fe3-ce8159cee9b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:57.467572 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-950a1645-bff4-4c0d-9fe3-ce8159cee9b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:57.469825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6f697f7b-c475-4572-84a3-bfd81891c8f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:57.475206 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-950a1645-bff4-4c0d-9fe3-ce8159cee9b6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.153809 Sep 13 06:40:57.476010 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 206/419] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:57 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:57.478377 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6f697f7b-c475-4572-84a3-bfd81891c8f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.161202 Sep 13 06:40:57.479424 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 214/420] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:57 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:57.480621 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fb84861e-6c26-4bfe-ab98-24362b33fafd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:57.481365 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fb84861e-6c26-4bfe-ab98-24362b33fafd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:57.483045 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:57.489768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb84861e-6c26-4bfe-ab98-24362b33fafd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:57.490249 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb84861e-6c26-4bfe-ab98-24362b33fafd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:57.490679 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb84861e-6c26-4bfe-ab98-24362b33fafd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:57.491419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb84861e-6c26-4bfe-ab98-24362b33fafd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:57.491869 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb84861e-6c26-4bfe-ab98-24362b33fafd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:57.492296 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb84861e-6c26-4bfe-ab98-24362b33fafd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:57.621260 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fb84861e-6c26-4bfe-ab98-24362b33fafd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:57.623557 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:57.630442 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fb84861e-6c26-4bfe-ab98-24362b33fafd tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.153370 Sep 13 06:40:57.631009 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 207/421] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:57 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:58.287477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-b592bd52-bd9a-497d-99ac-785cac1106c0 req-4602d64c-a3ea-441a-8103-053c81074334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b451b5fc-70f0-4e75-b74a-c839fc998e38", "tag": "a7742d75-3c78-40a9-8666-a3fc8f3dbe52"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:40:58.298913 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-b592bd52-bd9a-497d-99ac-785cac1106c0 req-4602d64c-a3ea-441a-8103-053c81074334 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:58.299515 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-b592bd52-bd9a-497d-99ac-785cac1106c0 req-4602d64c-a3ea-441a-8103-053c81074334 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:58.300010 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-b592bd52-bd9a-497d-99ac-785cac1106c0 req-4602d64c-a3ea-441a-8103-053c81074334 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:58.312519 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-b592bd52-bd9a-497d-99ac-785cac1106c0 req-4602d64c-a3ea-441a-8103-053c81074334 service nova] Creating event network-changed:a7742d75-3c78-40a9-8666-a3fc8f3dbe52 for instance b451b5fc-70f0-4e75-b74a-c839fc998e38 on hv-cinder-85638 Sep 13 06:40:58.318662 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-b592bd52-bd9a-497d-99ac-785cac1106c0 req-4602d64c-a3ea-441a-8103-053c81074334 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034906 Sep 13 06:40:58.319741 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 215/422] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:40:58.499754 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-01710455-9152-480f-a368-4962961f4233 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:58.500294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-01710455-9152-480f-a368-4962961f4233 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:58.500748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a9030b47-6b42-4647-963c-a7adc5be53eb tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:58.501441 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a9030b47-6b42-4647-963c-a7adc5be53eb tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:58.506727 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01710455-9152-480f-a368-4962961f4233 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:58.507235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01710455-9152-480f-a368-4962961f4233 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:58.507395 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9030b47-6b42-4647-963c-a7adc5be53eb tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:58.507697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01710455-9152-480f-a368-4962961f4233 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:58.507819 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9030b47-6b42-4647-963c-a7adc5be53eb tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:58.508187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9030b47-6b42-4647-963c-a7adc5be53eb tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:58.508382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01710455-9152-480f-a368-4962961f4233 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:58.508859 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9030b47-6b42-4647-963c-a7adc5be53eb tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:58.508957 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01710455-9152-480f-a368-4962961f4233 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:58.509278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-01710455-9152-480f-a368-4962961f4233 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:58.509390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9030b47-6b42-4647-963c-a7adc5be53eb tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:58.509707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9030b47-6b42-4647-963c-a7adc5be53eb tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:58.639409 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-01710455-9152-480f-a368-4962961f4233 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:58.646513 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a9030b47-6b42-4647-963c-a7adc5be53eb tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:58.647770 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-01710455-9152-480f-a368-4962961f4233 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.151883 Sep 13 06:40:58.648360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 208/423] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:58 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:58.653456 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c9234b50-9ee7-4183-9cf8-0eb0bf229c48 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:58.654059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c9234b50-9ee7-4183-9cf8-0eb0bf229c48 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:58.656471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a9030b47-6b42-4647-963c-a7adc5be53eb tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.159751 Sep 13 06:40:58.657205 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 216/424] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:58 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:58.660015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9234b50-9ee7-4183-9cf8-0eb0bf229c48 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:58.660528 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9234b50-9ee7-4183-9cf8-0eb0bf229c48 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:58.660967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9234b50-9ee7-4183-9cf8-0eb0bf229c48 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:58.661967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9234b50-9ee7-4183-9cf8-0eb0bf229c48 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:58.662775 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9234b50-9ee7-4183-9cf8-0eb0bf229c48 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:58.663554 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9234b50-9ee7-4183-9cf8-0eb0bf229c48 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:58.800442 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c9234b50-9ee7-4183-9cf8-0eb0bf229c48 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:58.807921 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c9234b50-9ee7-4183-9cf8-0eb0bf229c48 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.158484 Sep 13 06:40:58.808481 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 209/425] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:58 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:59.671092 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1fdf964d-c7b9-44ad-810e-183236816f13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:59.672318 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1fdf964d-c7b9-44ad-810e-183236816f13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:59.680308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fdf964d-c7b9-44ad-810e-183236816f13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:59.681346 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fdf964d-c7b9-44ad-810e-183236816f13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:59.681600 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5c361521-f069-400b-92cb-269d27bbcc0b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:59.682015 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fdf964d-c7b9-44ad-810e-183236816f13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:59.682453 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fdf964d-c7b9-44ad-810e-183236816f13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:59.682681 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5c361521-f069-400b-92cb-269d27bbcc0b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:59.682900 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fdf964d-c7b9-44ad-810e-183236816f13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:59.683317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fdf964d-c7b9-44ad-810e-183236816f13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:59.691169 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c361521-f069-400b-92cb-269d27bbcc0b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:59.691517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c361521-f069-400b-92cb-269d27bbcc0b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:59.691990 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c361521-f069-400b-92cb-269d27bbcc0b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:59.692872 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c361521-f069-400b-92cb-269d27bbcc0b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:59.693332 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c361521-f069-400b-92cb-269d27bbcc0b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:59.693752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c361521-f069-400b-92cb-269d27bbcc0b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:59.818498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1fdf964d-c7b9-44ad-810e-183236816f13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:59.826393 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1fdf964d-c7b9-44ad-810e-183236816f13 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.159123 Sep 13 06:40:59.827403 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 217/426] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:59 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:40:59.829360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5c361521-f069-400b-92cb-269d27bbcc0b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:59.834282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-405d96cf-a57e-43c3-8918-ce6cc404ab8d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:40:59.834896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-405d96cf-a57e-43c3-8918-ce6cc404ab8d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:40:59.837531 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5c361521-f069-400b-92cb-269d27bbcc0b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.160558 Sep 13 06:40:59.838183 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 210/427] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:59 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:40:59.841167 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-405d96cf-a57e-43c3-8918-ce6cc404ab8d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:59.841644 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-405d96cf-a57e-43c3-8918-ce6cc404ab8d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:59.842076 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-405d96cf-a57e-43c3-8918-ce6cc404ab8d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:59.842760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-405d96cf-a57e-43c3-8918-ce6cc404ab8d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:40:59.843212 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-405d96cf-a57e-43c3-8918-ce6cc404ab8d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:40:59.843654 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-405d96cf-a57e-43c3-8918-ce6cc404ab8d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:40:59.972679 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-405d96cf-a57e-43c3-8918-ce6cc404ab8d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:40:59.980957 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-405d96cf-a57e-43c3-8918-ce6cc404ab8d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.152848 Sep 13 06:40:59.981524 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 218/428] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:40:59 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:00.848839 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-09ef6d89-7518-4d20-9d54-19eb88a774cb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:00.849373 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-09ef6d89-7518-4d20-9d54-19eb88a774cb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:00.856875 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09ef6d89-7518-4d20-9d54-19eb88a774cb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:00.857351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09ef6d89-7518-4d20-9d54-19eb88a774cb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:00.857778 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09ef6d89-7518-4d20-9d54-19eb88a774cb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:00.858463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09ef6d89-7518-4d20-9d54-19eb88a774cb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:00.858912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09ef6d89-7518-4d20-9d54-19eb88a774cb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:00.859033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ab8e5c4e-92ee-4236-a87d-aba7f7255e6a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:00.859485 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09ef6d89-7518-4d20-9d54-19eb88a774cb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:00.859646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ab8e5c4e-92ee-4236-a87d-aba7f7255e6a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:00.865510 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab8e5c4e-92ee-4236-a87d-aba7f7255e6a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:00.865993 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab8e5c4e-92ee-4236-a87d-aba7f7255e6a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:00.866426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab8e5c4e-92ee-4236-a87d-aba7f7255e6a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:00.867111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab8e5c4e-92ee-4236-a87d-aba7f7255e6a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:00.867593 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab8e5c4e-92ee-4236-a87d-aba7f7255e6a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:00.868608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ab8e5c4e-92ee-4236-a87d-aba7f7255e6a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:00.990174 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-09ef6d89-7518-4d20-9d54-19eb88a774cb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:00.997948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-09ef6d89-7518-4d20-9d54-19eb88a774cb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.152999 Sep 13 06:41:00.998102 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ab8e5c4e-92ee-4236-a87d-aba7f7255e6a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:00.998520 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 211/429] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:00 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:01.005488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c44775c9-16a4-4eac-bef4-60848be2adb1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:01.005749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ab8e5c4e-92ee-4236-a87d-aba7f7255e6a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.150491 Sep 13 06:41:01.006089 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c44775c9-16a4-4eac-bef4-60848be2adb1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:01.016473 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 219/430] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:00 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:01.016623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c44775c9-16a4-4eac-bef4-60848be2adb1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:01.016623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c44775c9-16a4-4eac-bef4-60848be2adb1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:01.016623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c44775c9-16a4-4eac-bef4-60848be2adb1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:01.016623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c44775c9-16a4-4eac-bef4-60848be2adb1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:01.016974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c44775c9-16a4-4eac-bef4-60848be2adb1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:01.016974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c44775c9-16a4-4eac-bef4-60848be2adb1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:01.142724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c44775c9-16a4-4eac-bef4-60848be2adb1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:01.150704 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c44775c9-16a4-4eac-bef4-60848be2adb1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.148777 Sep 13 06:41:01.151252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 212/431] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:01 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:02.020386 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-38911ed6-0994-4cad-86fc-df10e5bbc891 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:02.020982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-38911ed6-0994-4cad-86fc-df10e5bbc891 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:02.027386 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38911ed6-0994-4cad-86fc-df10e5bbc891 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:02.027876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38911ed6-0994-4cad-86fc-df10e5bbc891 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:02.028052 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ff6349ad-562b-4f13-91dd-586e63433600 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:02.028442 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38911ed6-0994-4cad-86fc-df10e5bbc891 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:02.028960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38911ed6-0994-4cad-86fc-df10e5bbc891 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:02.029275 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ff6349ad-562b-4f13-91dd-586e63433600 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:02.029404 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38911ed6-0994-4cad-86fc-df10e5bbc891 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:02.029817 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38911ed6-0994-4cad-86fc-df10e5bbc891 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:02.035335 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6349ad-562b-4f13-91dd-586e63433600 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:02.035837 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6349ad-562b-4f13-91dd-586e63433600 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:02.036271 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6349ad-562b-4f13-91dd-586e63433600 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:02.036958 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6349ad-562b-4f13-91dd-586e63433600 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:02.037414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6349ad-562b-4f13-91dd-586e63433600 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:02.037838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6349ad-562b-4f13-91dd-586e63433600 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:02.160537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-38911ed6-0994-4cad-86fc-df10e5bbc891 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:02.167730 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ff6349ad-562b-4f13-91dd-586e63433600 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:02.168599 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-38911ed6-0994-4cad-86fc-df10e5bbc891 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.151951 Sep 13 06:41:02.169271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 220/432] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:02 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:02.173785 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-51333e1d-6300-48fb-9ba8-acd47e691515 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:02.174385 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-51333e1d-6300-48fb-9ba8-acd47e691515 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:02.176360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ff6349ad-562b-4f13-91dd-586e63433600 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.152405 Sep 13 06:41:02.177337 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 213/433] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:02 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:02.182450 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51333e1d-6300-48fb-9ba8-acd47e691515 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:02.182957 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51333e1d-6300-48fb-9ba8-acd47e691515 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:02.183410 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51333e1d-6300-48fb-9ba8-acd47e691515 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:02.184108 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51333e1d-6300-48fb-9ba8-acd47e691515 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:02.184556 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51333e1d-6300-48fb-9ba8-acd47e691515 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:02.184968 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51333e1d-6300-48fb-9ba8-acd47e691515 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:02.314982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-51333e1d-6300-48fb-9ba8-acd47e691515 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:02.322787 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-51333e1d-6300-48fb-9ba8-acd47e691515 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.152548 Sep 13 06:41:02.323351 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 221/434] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:02 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:03.191081 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4fe57731-ea18-4884-a0ac-31ff6cc1c28c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:03.191714 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4fe57731-ea18-4884-a0ac-31ff6cc1c28c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:03.199038 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fe57731-ea18-4884-a0ac-31ff6cc1c28c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:03.199208 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c29d390e-0461-4b75-b1f5-6f9d6173ddec tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:03.199657 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fe57731-ea18-4884-a0ac-31ff6cc1c28c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:03.199806 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c29d390e-0461-4b75-b1f5-6f9d6173ddec tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:03.199977 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fe57731-ea18-4884-a0ac-31ff6cc1c28c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:03.200673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fe57731-ea18-4884-a0ac-31ff6cc1c28c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:03.201130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fe57731-ea18-4884-a0ac-31ff6cc1c28c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:03.201555 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fe57731-ea18-4884-a0ac-31ff6cc1c28c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:03.205545 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c29d390e-0461-4b75-b1f5-6f9d6173ddec tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:03.206022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c29d390e-0461-4b75-b1f5-6f9d6173ddec tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:03.206446 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c29d390e-0461-4b75-b1f5-6f9d6173ddec tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:03.207133 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c29d390e-0461-4b75-b1f5-6f9d6173ddec tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:03.207605 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c29d390e-0461-4b75-b1f5-6f9d6173ddec tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:03.208020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c29d390e-0461-4b75-b1f5-6f9d6173ddec tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:03.335063 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4fe57731-ea18-4884-a0ac-31ff6cc1c28c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:03.347458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c29d390e-0461-4b75-b1f5-6f9d6173ddec tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:03.347650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4fe57731-ea18-4884-a0ac-31ff6cc1c28c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.156469 Sep 13 06:41:03.347650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 214/435] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:03 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:03.349021 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c13a9eb7-9c86-4a40-aafd-56d9e4736c2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:03.349617 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c13a9eb7-9c86-4a40-aafd-56d9e4736c2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:03.353629 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c29d390e-0461-4b75-b1f5-6f9d6173ddec tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.158768 Sep 13 06:41:03.354603 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 222/436] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:03 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:03.355316 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c13a9eb7-9c86-4a40-aafd-56d9e4736c2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:03.355835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c13a9eb7-9c86-4a40-aafd-56d9e4736c2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:03.356270 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c13a9eb7-9c86-4a40-aafd-56d9e4736c2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:03.356963 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c13a9eb7-9c86-4a40-aafd-56d9e4736c2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:03.357449 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c13a9eb7-9c86-4a40-aafd-56d9e4736c2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:03.357840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c13a9eb7-9c86-4a40-aafd-56d9e4736c2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:03.484432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c13a9eb7-9c86-4a40-aafd-56d9e4736c2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:03.492109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c13a9eb7-9c86-4a40-aafd-56d9e4736c2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.146549 Sep 13 06:41:03.492670 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 215/437] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:03 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:04.366241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-08f87f98-0489-42a9-864f-8d2786f42c5a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:04.366758 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-08f87f98-0489-42a9-864f-8d2786f42c5a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:04.372730 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-08f87f98-0489-42a9-864f-8d2786f42c5a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:04.373216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-08f87f98-0489-42a9-864f-8d2786f42c5a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:04.373651 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-08f87f98-0489-42a9-864f-8d2786f42c5a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:04.374342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-08f87f98-0489-42a9-864f-8d2786f42c5a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:04.374797 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-08f87f98-0489-42a9-864f-8d2786f42c5a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:04.375216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-08f87f98-0489-42a9-864f-8d2786f42c5a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:04.376284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-18979962-85b7-4b62-a1a6-3f151c66997b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:04.376902 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-18979962-85b7-4b62-a1a6-3f151c66997b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:04.383921 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18979962-85b7-4b62-a1a6-3f151c66997b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:04.384407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18979962-85b7-4b62-a1a6-3f151c66997b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:04.384841 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18979962-85b7-4b62-a1a6-3f151c66997b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:04.385535 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18979962-85b7-4b62-a1a6-3f151c66997b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:04.385993 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18979962-85b7-4b62-a1a6-3f151c66997b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:04.386415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18979962-85b7-4b62-a1a6-3f151c66997b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:04.515099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-08f87f98-0489-42a9-864f-8d2786f42c5a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:04.522663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-08f87f98-0489-42a9-864f-8d2786f42c5a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.160291 Sep 13 06:41:04.528204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-18979962-85b7-4b62-a1a6-3f151c66997b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:04.532536 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 223/438] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:04 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:04.537538 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-18979962-85b7-4b62-a1a6-3f151c66997b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.164765 Sep 13 06:41:04.538280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 216/439] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:04 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:04.544567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e0fdb50e-5c11-491c-91d3-ecdb3ed193f4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:04.545238 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e0fdb50e-5c11-491c-91d3-ecdb3ed193f4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:04.551460 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0fdb50e-5c11-491c-91d3-ecdb3ed193f4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:04.552785 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0fdb50e-5c11-491c-91d3-ecdb3ed193f4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:04.553311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0fdb50e-5c11-491c-91d3-ecdb3ed193f4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:04.553974 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0fdb50e-5c11-491c-91d3-ecdb3ed193f4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:04.554336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0fdb50e-5c11-491c-91d3-ecdb3ed193f4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:04.554988 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e0fdb50e-5c11-491c-91d3-ecdb3ed193f4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:04.557582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:04.684679 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e0fdb50e-5c11-491c-91d3-ecdb3ed193f4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:04.692345 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e0fdb50e-5c11-491c-91d3-ecdb3ed193f4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.158786 Sep 13 06:41:04.692910 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 224/440] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:04 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:05.549543 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ddbcf9a3-991b-41d5-bdba-c139b0302c97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:05.550181 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ddbcf9a3-991b-41d5-bdba-c139b0302c97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:05.557020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddbcf9a3-991b-41d5-bdba-c139b0302c97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:05.557505 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddbcf9a3-991b-41d5-bdba-c139b0302c97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:05.557943 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddbcf9a3-991b-41d5-bdba-c139b0302c97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:05.558639 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddbcf9a3-991b-41d5-bdba-c139b0302c97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:05.559096 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddbcf9a3-991b-41d5-bdba-c139b0302c97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:05.559555 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ddbcf9a3-991b-41d5-bdba-c139b0302c97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:05.561500 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e22878bb-a1d6-4b38-a801-dc9d982d5fe1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:05.562111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e22878bb-a1d6-4b38-a801-dc9d982d5fe1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:05.568048 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e22878bb-a1d6-4b38-a801-dc9d982d5fe1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:05.568525 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e22878bb-a1d6-4b38-a801-dc9d982d5fe1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:05.568987 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e22878bb-a1d6-4b38-a801-dc9d982d5fe1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:05.569655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e22878bb-a1d6-4b38-a801-dc9d982d5fe1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:05.570109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e22878bb-a1d6-4b38-a801-dc9d982d5fe1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:05.570544 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e22878bb-a1d6-4b38-a801-dc9d982d5fe1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:05.714201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ddbcf9a3-991b-41d5-bdba-c139b0302c97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:05.727625 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ddbcf9a3-991b-41d5-bdba-c139b0302c97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1371 microversion: 2.1 time: 0.181650 Sep 13 06:41:05.729428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 217/441] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:05 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:05.729743 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e22878bb-a1d6-4b38-a801-dc9d982d5fe1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:05.734858 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-621e8c80-5e16-4db0-95af-ca77e5602794 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:05.735500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-621e8c80-5e16-4db0-95af-ca77e5602794 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:05.741322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-621e8c80-5e16-4db0-95af-ca77e5602794 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:05.741817 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-621e8c80-5e16-4db0-95af-ca77e5602794 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:05.742231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-621e8c80-5e16-4db0-95af-ca77e5602794 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:05.743468 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-621e8c80-5e16-4db0-95af-ca77e5602794 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:05.743927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-621e8c80-5e16-4db0-95af-ca77e5602794 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:05.744347 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-621e8c80-5e16-4db0-95af-ca77e5602794 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:05.750466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e22878bb-a1d6-4b38-a801-dc9d982d5fe1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1265 microversion: 2.1 time: 0.192637 Sep 13 06:41:05.751135 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 225/442] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:05 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:05.927576 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-621e8c80-5e16-4db0-95af-ca77e5602794 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:05.936238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-621e8c80-5e16-4db0-95af-ca77e5602794 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.205178 Sep 13 06:41:05.937073 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 218/443] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:05 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:06.755423 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5c3f0e14-41e9-46e4-b010-424f55de1898 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:06.756024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5c3f0e14-41e9-46e4-b010-424f55de1898 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:06.762487 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5c3f0e14-41e9-46e4-b010-424f55de1898 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:06.762966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5c3f0e14-41e9-46e4-b010-424f55de1898 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:06.763414 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5c3f0e14-41e9-46e4-b010-424f55de1898 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:06.764102 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5c3f0e14-41e9-46e4-b010-424f55de1898 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:06.764555 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5c3f0e14-41e9-46e4-b010-424f55de1898 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:06.764977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5c3f0e14-41e9-46e4-b010-424f55de1898 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:06.773138 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9e4e09a2-d8cf-478e-a1f1-5ff5a33b0b4a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:06.773751 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9e4e09a2-d8cf-478e-a1f1-5ff5a33b0b4a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:06.780840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e4e09a2-d8cf-478e-a1f1-5ff5a33b0b4a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:06.781330 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e4e09a2-d8cf-478e-a1f1-5ff5a33b0b4a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:06.781771 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e4e09a2-d8cf-478e-a1f1-5ff5a33b0b4a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:06.782465 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e4e09a2-d8cf-478e-a1f1-5ff5a33b0b4a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:06.782985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e4e09a2-d8cf-478e-a1f1-5ff5a33b0b4a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:06.783432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e4e09a2-d8cf-478e-a1f1-5ff5a33b0b4a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:06.893234 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5c3f0e14-41e9-46e4-b010-424f55de1898 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:06.901558 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5c3f0e14-41e9-46e4-b010-424f55de1898 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1564 microversion: 2.1 time: 0.150011 Sep 13 06:41:06.902125 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 226/444] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:06 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:06.917578 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9e4e09a2-d8cf-478e-a1f1-5ff5a33b0b4a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:06.924430 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fdf051be-3649-45bf-9c77-f8dbd82349f2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:06.924912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-fdf051be-3649-45bf-9c77-f8dbd82349f2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:06.925498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9e4e09a2-d8cf-478e-a1f1-5ff5a33b0b4a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1451 microversion: 2.1 time: 0.156136 Sep 13 06:41:06.926061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 219/445] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:06 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:06.931273 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fdf051be-3649-45bf-9c77-f8dbd82349f2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:06.931773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fdf051be-3649-45bf-9c77-f8dbd82349f2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:06.932197 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fdf051be-3649-45bf-9c77-f8dbd82349f2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:06.932878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fdf051be-3649-45bf-9c77-f8dbd82349f2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:06.933321 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fdf051be-3649-45bf-9c77-f8dbd82349f2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:06.933740 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fdf051be-3649-45bf-9c77-f8dbd82349f2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:06.949358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-22d8d373-01b3-4fa3-acdc-41f857758b08 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:06.949974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-22d8d373-01b3-4fa3-acdc-41f857758b08 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:06.956145 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22d8d373-01b3-4fa3-acdc-41f857758b08 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:06.956640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22d8d373-01b3-4fa3-acdc-41f857758b08 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:06.957087 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22d8d373-01b3-4fa3-acdc-41f857758b08 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:06.957791 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22d8d373-01b3-4fa3-acdc-41f857758b08 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:06.958255 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22d8d373-01b3-4fa3-acdc-41f857758b08 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:06.958768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22d8d373-01b3-4fa3-acdc-41f857758b08 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:07.027471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fdf051be-3649-45bf-9c77-f8dbd82349f2 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106659 Sep 13 06:41:07.035303 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 227/446] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Sep 13 06:41:06 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:41:07.035303 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f9ac6b18-e6a4-48cb-afc5-814f234a0ed4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:07.035303 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f9ac6b18-e6a4-48cb-afc5-814f234a0ed4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:07.039138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9ac6b18-e6a4-48cb-afc5-814f234a0ed4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:07.039942 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9ac6b18-e6a4-48cb-afc5-814f234a0ed4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:07.040376 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9ac6b18-e6a4-48cb-afc5-814f234a0ed4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:07.041125 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9ac6b18-e6a4-48cb-afc5-814f234a0ed4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:07.041592 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9ac6b18-e6a4-48cb-afc5-814f234a0ed4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:07.042021 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9ac6b18-e6a4-48cb-afc5-814f234a0ed4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:07.119863 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-22d8d373-01b3-4fa3-acdc-41f857758b08 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:07.127979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-22d8d373-01b3-4fa3-acdc-41f857758b08 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1451 microversion: 2.1 time: 0.183259 Sep 13 06:41:07.129103 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 220/447] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:06 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:07.345043 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f9ac6b18-e6a4-48cb-afc5-814f234a0ed4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:07.355338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f9ac6b18-e6a4-48cb-afc5-814f234a0ed4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.326076 Sep 13 06:41:07.359629 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 228/448] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:07 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:08.381794 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6dcffd27-f43d-4455-8a5a-ba459991b14a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:08.382632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6dcffd27-f43d-4455-8a5a-ba459991b14a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:08.389011 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6dcffd27-f43d-4455-8a5a-ba459991b14a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:08.389589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6dcffd27-f43d-4455-8a5a-ba459991b14a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:08.390523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6dcffd27-f43d-4455-8a5a-ba459991b14a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:08.390842 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6dcffd27-f43d-4455-8a5a-ba459991b14a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:08.391379 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6dcffd27-f43d-4455-8a5a-ba459991b14a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:08.392648 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6dcffd27-f43d-4455-8a5a-ba459991b14a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:08.533063 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6dcffd27-f43d-4455-8a5a-ba459991b14a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:08.541015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6dcffd27-f43d-4455-8a5a-ba459991b14a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.163055 Sep 13 06:41:08.541575 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 221/449] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:08 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:08.687304 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-70c0520d-e97d-4f0e-9a00-b9d1aa7f1173 req-c99ac96c-84b4-4669-97af-aba04f649a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2001137-a4ff-4946-bc5e-56f38c00f36e", "tag": "48d46bd9-6b3e-4011-86f2-51e97c672d79"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:08.698192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-70c0520d-e97d-4f0e-9a00-b9d1aa7f1173 req-c99ac96c-84b4-4669-97af-aba04f649a14 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:08.698672 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-70c0520d-e97d-4f0e-9a00-b9d1aa7f1173 req-c99ac96c-84b4-4669-97af-aba04f649a14 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:08.699102 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-70c0520d-e97d-4f0e-9a00-b9d1aa7f1173 req-c99ac96c-84b4-4669-97af-aba04f649a14 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:08.710853 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-70c0520d-e97d-4f0e-9a00-b9d1aa7f1173 req-c99ac96c-84b4-4669-97af-aba04f649a14 service nova] Creating event network-changed:48d46bd9-6b3e-4011-86f2-51e97c672d79 for instance d2001137-a4ff-4946-bc5e-56f38c00f36e on hv-cinder-85638 Sep 13 06:41:08.716158 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-70c0520d-e97d-4f0e-9a00-b9d1aa7f1173 req-c99ac96c-84b4-4669-97af-aba04f649a14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032774 Sep 13 06:41:08.716789 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 229/450] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:41:09.563932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b2a2e2a9-16e3-4899-85d2-f9204cfe79a1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:09.564533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b2a2e2a9-16e3-4899-85d2-f9204cfe79a1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:09.571807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b2a2e2a9-16e3-4899-85d2-f9204cfe79a1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:09.572293 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b2a2e2a9-16e3-4899-85d2-f9204cfe79a1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:09.572724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b2a2e2a9-16e3-4899-85d2-f9204cfe79a1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:09.573412 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b2a2e2a9-16e3-4899-85d2-f9204cfe79a1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:09.573864 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b2a2e2a9-16e3-4899-85d2-f9204cfe79a1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:09.574280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b2a2e2a9-16e3-4899-85d2-f9204cfe79a1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:09.723936 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b2a2e2a9-16e3-4899-85d2-f9204cfe79a1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:09.731950 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b2a2e2a9-16e3-4899-85d2-f9204cfe79a1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.171854 Sep 13 06:41:09.732718 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 222/451] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:09 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:10.733010 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-5e3f272d-74e3-497c-8d41-15311518bce5 req-47e8eb58-b627-4ad3-b143-eb777c9a34a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "462ba976-b35b-433e-b247-03eaef8428a5", "tag": "15fd17c0-6cb3-46dd-adc1-2ec4c2d2560d"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:10.742654 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-5e3f272d-74e3-497c-8d41-15311518bce5 req-47e8eb58-b627-4ad3-b143-eb777c9a34a1 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:10.743124 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-5e3f272d-74e3-497c-8d41-15311518bce5 req-47e8eb58-b627-4ad3-b143-eb777c9a34a1 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:10.743582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-5e3f272d-74e3-497c-8d41-15311518bce5 req-47e8eb58-b627-4ad3-b143-eb777c9a34a1 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:10.754658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-057980f9-1343-4ed5-9263-6e96b965c129 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:10.755666 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-057980f9-1343-4ed5-9263-6e96b965c129 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:10.757030 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-5e3f272d-74e3-497c-8d41-15311518bce5 req-47e8eb58-b627-4ad3-b143-eb777c9a34a1 service nova] Creating event network-changed:15fd17c0-6cb3-46dd-adc1-2ec4c2d2560d for instance 462ba976-b35b-433e-b247-03eaef8428a5 on hv-cinder-85638 Sep 13 06:41:10.761841 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-5e3f272d-74e3-497c-8d41-15311518bce5 req-47e8eb58-b627-4ad3-b143-eb777c9a34a1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033311 Sep 13 06:41:10.765439 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 230/452] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:41:10.766455 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-057980f9-1343-4ed5-9263-6e96b965c129 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:10.766950 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-057980f9-1343-4ed5-9263-6e96b965c129 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:10.767402 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-057980f9-1343-4ed5-9263-6e96b965c129 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:10.768103 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-057980f9-1343-4ed5-9263-6e96b965c129 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:10.768589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-057980f9-1343-4ed5-9263-6e96b965c129 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:10.769007 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-057980f9-1343-4ed5-9263-6e96b965c129 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:10.898298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-057980f9-1343-4ed5-9263-6e96b965c129 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:10.906608 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-057980f9-1343-4ed5-9263-6e96b965c129 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.156033 Sep 13 06:41:10.907176 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 223/453] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:10 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:11.930488 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5cda4c8c-9a75-4981-b361-413f2e8cfb08 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:11.931188 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5cda4c8c-9a75-4981-b361-413f2e8cfb08 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:11.937295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5cda4c8c-9a75-4981-b361-413f2e8cfb08 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:11.937786 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5cda4c8c-9a75-4981-b361-413f2e8cfb08 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:11.938216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5cda4c8c-9a75-4981-b361-413f2e8cfb08 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:11.938902 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5cda4c8c-9a75-4981-b361-413f2e8cfb08 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:11.939474 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5cda4c8c-9a75-4981-b361-413f2e8cfb08 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:11.939820 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5cda4c8c-9a75-4981-b361-413f2e8cfb08 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:12.158636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5cda4c8c-9a75-4981-b361-413f2e8cfb08 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:12.166933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5cda4c8c-9a75-4981-b361-413f2e8cfb08 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.240606 Sep 13 06:41:12.167791 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 231/454] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:11 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:12.852827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7057371d-5930-400b-a339-b6020625a51d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:12.853918 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7057371d-5930-400b-a339-b6020625a51d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:12.861039 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7057371d-5930-400b-a339-b6020625a51d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:12.861981 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7057371d-5930-400b-a339-b6020625a51d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:12.862626 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7057371d-5930-400b-a339-b6020625a51d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:12.863552 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7057371d-5930-400b-a339-b6020625a51d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:12.864226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7057371d-5930-400b-a339-b6020625a51d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:12.864840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7057371d-5930-400b-a339-b6020625a51d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:12.880439 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:12.891109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7057371d-5930-400b-a339-b6020625a51d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/ips" status: 200 len: 146 microversion: 2.1 time: 0.042960 Sep 13 06:41:12.891769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 224/455] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Sep 13 06:41:12 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:41:13.190219 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8b7aa27b-8d89-484f-9a4c-0bf7639e49c1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:13.190822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8b7aa27b-8d89-484f-9a4c-0bf7639e49c1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:13.196621 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b7aa27b-8d89-484f-9a4c-0bf7639e49c1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:13.197689 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b7aa27b-8d89-484f-9a4c-0bf7639e49c1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:13.198117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b7aa27b-8d89-484f-9a4c-0bf7639e49c1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:13.198793 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b7aa27b-8d89-484f-9a4c-0bf7639e49c1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:13.199237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b7aa27b-8d89-484f-9a4c-0bf7639e49c1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:13.199678 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b7aa27b-8d89-484f-9a4c-0bf7639e49c1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:13.328507 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8b7aa27b-8d89-484f-9a4c-0bf7639e49c1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:13.336065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8b7aa27b-8d89-484f-9a4c-0bf7639e49c1 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.149782 Sep 13 06:41:13.336632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 232/456] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:13 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:14.359666 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f51f402f-318a-4bd7-94b6-3c33aacf784f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:14.360266 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f51f402f-318a-4bd7-94b6-3c33aacf784f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:14.366542 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f51f402f-318a-4bd7-94b6-3c33aacf784f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:14.367016 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f51f402f-318a-4bd7-94b6-3c33aacf784f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:14.367484 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f51f402f-318a-4bd7-94b6-3c33aacf784f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:14.368164 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f51f402f-318a-4bd7-94b6-3c33aacf784f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:14.369272 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f51f402f-318a-4bd7-94b6-3c33aacf784f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:14.369706 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f51f402f-318a-4bd7-94b6-3c33aacf784f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:14.501947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f51f402f-318a-4bd7-94b6-3c33aacf784f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:14.509995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f51f402f-318a-4bd7-94b6-3c33aacf784f tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.154154 Sep 13 06:41:14.510562 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 225/457] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:14 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:15.533174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-90d95eda-a7a2-40ef-8b6c-ea119ceb0ded tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:15.533763 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-90d95eda-a7a2-40ef-8b6c-ea119ceb0ded tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:15.540075 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90d95eda-a7a2-40ef-8b6c-ea119ceb0ded tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:15.541079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90d95eda-a7a2-40ef-8b6c-ea119ceb0ded tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:15.541510 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90d95eda-a7a2-40ef-8b6c-ea119ceb0ded tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:15.542196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90d95eda-a7a2-40ef-8b6c-ea119ceb0ded tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:15.542852 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90d95eda-a7a2-40ef-8b6c-ea119ceb0ded tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:15.543267 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90d95eda-a7a2-40ef-8b6c-ea119ceb0ded tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:15.978747 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-90d95eda-a7a2-40ef-8b6c-ea119ceb0ded tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:15.986436 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-90d95eda-a7a2-40ef-8b6c-ea119ceb0ded tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.457178 Sep 13 06:41:15.987003 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 233/458] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:15 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:16.513198 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-730ee115-ea43-4ed7-8a53-f12ce1a44609 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1349415-18e6-4537-b566-4a61c5f3b5a6"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:16.516541 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-730ee115-ea43-4ed7-8a53-f12ce1a44609 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:16.525881 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-730ee115-ea43-4ed7-8a53-f12ce1a44609 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:16.526380 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-730ee115-ea43-4ed7-8a53-f12ce1a44609 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:16.526821 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-730ee115-ea43-4ed7-8a53-f12ce1a44609 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:16.527566 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-730ee115-ea43-4ed7-8a53-f12ce1a44609 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:16.528053 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-730ee115-ea43-4ed7-8a53-f12ce1a44609 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:16.528478 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-730ee115-ea43-4ed7-8a53-f12ce1a44609 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:16.812617 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-730ee115-ea43-4ed7-8a53-f12ce1a44609 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305806 Sep 13 06:41:16.813233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 226/459] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:41:16 2022] POST /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:41:17.008843 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-213225b2-7726-4b00-a3e8-8135f1524ec0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:17.011186 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-213225b2-7726-4b00-a3e8-8135f1524ec0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:17.017776 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213225b2-7726-4b00-a3e8-8135f1524ec0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:17.018249 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213225b2-7726-4b00-a3e8-8135f1524ec0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:17.018682 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213225b2-7726-4b00-a3e8-8135f1524ec0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:17.019388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213225b2-7726-4b00-a3e8-8135f1524ec0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:17.019843 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213225b2-7726-4b00-a3e8-8135f1524ec0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:17.020257 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213225b2-7726-4b00-a3e8-8135f1524ec0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:17.182252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-213225b2-7726-4b00-a3e8-8135f1524ec0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:17.189795 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-213225b2-7726-4b00-a3e8-8135f1524ec0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.184788 Sep 13 06:41:17.190359 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 234/460] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:17 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:18.213688 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4a6bf783-6dd0-4691-a59f-df0524fa7bd0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:18.214386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4a6bf783-6dd0-4691-a59f-df0524fa7bd0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:18.222488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a6bf783-6dd0-4691-a59f-df0524fa7bd0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:18.222978 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a6bf783-6dd0-4691-a59f-df0524fa7bd0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:18.223433 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a6bf783-6dd0-4691-a59f-df0524fa7bd0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:18.224243 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a6bf783-6dd0-4691-a59f-df0524fa7bd0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:18.224694 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a6bf783-6dd0-4691-a59f-df0524fa7bd0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:18.225226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a6bf783-6dd0-4691-a59f-df0524fa7bd0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:18.371097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4a6bf783-6dd0-4691-a59f-df0524fa7bd0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:18.380958 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4a6bf783-6dd0-4691-a59f-df0524fa7bd0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.171675 Sep 13 06:41:18.381534 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 227/461] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:18 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:19.406817 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-18f5b8a9-0e0b-4707-b85c-47e9cb62cba4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:19.407485 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-18f5b8a9-0e0b-4707-b85c-47e9cb62cba4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:19.413301 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18f5b8a9-0e0b-4707-b85c-47e9cb62cba4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:19.413780 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18f5b8a9-0e0b-4707-b85c-47e9cb62cba4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:19.414211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18f5b8a9-0e0b-4707-b85c-47e9cb62cba4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:19.415148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18f5b8a9-0e0b-4707-b85c-47e9cb62cba4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:19.415637 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18f5b8a9-0e0b-4707-b85c-47e9cb62cba4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:19.416061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18f5b8a9-0e0b-4707-b85c-47e9cb62cba4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:19.542922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-18f5b8a9-0e0b-4707-b85c-47e9cb62cba4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:19.550440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-18f5b8a9-0e0b-4707-b85c-47e9cb62cba4 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.147483 Sep 13 06:41:19.550997 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 235/462] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:19 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:19.932715 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-5f23534c-8813-465d-9f26-9b0309176bc0 req-92614c7b-45a7-4752-ae1f-8098f9b4da7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b451b5fc-70f0-4e75-b74a-c839fc998e38", "name": "network-vif-plugged", "status": "completed", "tag": "a7742d75-3c78-40a9-8666-a3fc8f3dbe52"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:19.944932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5f23534c-8813-465d-9f26-9b0309176bc0 req-92614c7b-45a7-4752-ae1f-8098f9b4da7a service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:19.945419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5f23534c-8813-465d-9f26-9b0309176bc0 req-92614c7b-45a7-4752-ae1f-8098f9b4da7a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:19.945847 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5f23534c-8813-465d-9f26-9b0309176bc0 req-92614c7b-45a7-4752-ae1f-8098f9b4da7a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:19.957463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-5f23534c-8813-465d-9f26-9b0309176bc0 req-92614c7b-45a7-4752-ae1f-8098f9b4da7a service nova] Creating event network-vif-plugged:a7742d75-3c78-40a9-8666-a3fc8f3dbe52 for instance b451b5fc-70f0-4e75-b74a-c839fc998e38 on hv-cinder-85638 Sep 13 06:41:19.962248 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-5f23534c-8813-465d-9f26-9b0309176bc0 req-92614c7b-45a7-4752-ae1f-8098f9b4da7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033681 Sep 13 06:41:19.962831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 228/463] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:41:20.573572 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-915db9d9-74c0-4c6b-95b6-86f1d93ed2f9 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:20.574187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-915db9d9-74c0-4c6b-95b6-86f1d93ed2f9 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:20.579964 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-915db9d9-74c0-4c6b-95b6-86f1d93ed2f9 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:20.580451 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-915db9d9-74c0-4c6b-95b6-86f1d93ed2f9 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:20.581077 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-915db9d9-74c0-4c6b-95b6-86f1d93ed2f9 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:20.581773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-915db9d9-74c0-4c6b-95b6-86f1d93ed2f9 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:20.582232 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-915db9d9-74c0-4c6b-95b6-86f1d93ed2f9 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:20.582658 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-915db9d9-74c0-4c6b-95b6-86f1d93ed2f9 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:20.716271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-915db9d9-74c0-4c6b-95b6-86f1d93ed2f9 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:20.723974 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-915db9d9-74c0-4c6b-95b6-86f1d93ed2f9 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.154792 Sep 13 06:41:20.724807 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 236/464] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:20 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:21.747216 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-96a93e87-505d-4847-8458-cc5302cef38d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:21.747949 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-96a93e87-505d-4847-8458-cc5302cef38d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:21.754707 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-96a93e87-505d-4847-8458-cc5302cef38d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:21.755188 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-96a93e87-505d-4847-8458-cc5302cef38d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:21.755720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-96a93e87-505d-4847-8458-cc5302cef38d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:21.756409 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-96a93e87-505d-4847-8458-cc5302cef38d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:21.756867 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-96a93e87-505d-4847-8458-cc5302cef38d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:21.757289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-96a93e87-505d-4847-8458-cc5302cef38d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:21.887758 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-96a93e87-505d-4847-8458-cc5302cef38d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:21.895314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-96a93e87-505d-4847-8458-cc5302cef38d tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1358 microversion: 2.1 time: 0.152988 Sep 13 06:41:21.895900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 229/465] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:21 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:22.918228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-07226c2f-baef-4cb5-ad4d-3a4a09d894aa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:22.918858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-07226c2f-baef-4cb5-ad4d-3a4a09d894aa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:22.924955 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07226c2f-baef-4cb5-ad4d-3a4a09d894aa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:22.925442 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07226c2f-baef-4cb5-ad4d-3a4a09d894aa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:22.925882 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07226c2f-baef-4cb5-ad4d-3a4a09d894aa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:22.926635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07226c2f-baef-4cb5-ad4d-3a4a09d894aa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:22.927085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07226c2f-baef-4cb5-ad4d-3a4a09d894aa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:22.927554 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-07226c2f-baef-4cb5-ad4d-3a4a09d894aa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:23.058459 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-07226c2f-baef-4cb5-ad4d-3a4a09d894aa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:23.066330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-07226c2f-baef-4cb5-ad4d-3a4a09d894aa tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1548 microversion: 2.1 time: 0.152005 Sep 13 06:41:23.066896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 237/466] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:22 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:23.090019 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-aba481d0-71f0-4fdc-9ec2-707a6c0136d0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:23.090623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-aba481d0-71f0-4fdc-9ec2-707a6c0136d0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:23.096955 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aba481d0-71f0-4fdc-9ec2-707a6c0136d0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:23.097430 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aba481d0-71f0-4fdc-9ec2-707a6c0136d0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:23.097888 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aba481d0-71f0-4fdc-9ec2-707a6c0136d0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:23.098569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aba481d0-71f0-4fdc-9ec2-707a6c0136d0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:23.099545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aba481d0-71f0-4fdc-9ec2-707a6c0136d0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:23.099545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aba481d0-71f0-4fdc-9ec2-707a6c0136d0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:23.230615 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-aba481d0-71f0-4fdc-9ec2-707a6c0136d0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:23.238375 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-aba481d0-71f0-4fdc-9ec2-707a6c0136d0 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1548 microversion: 2.1 time: 0.152156 Sep 13 06:41:23.238929 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 230/467] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:23 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:23.259981 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:23.264700 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:23.265447 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Searching by: {'deleted': False, 'project_id': 'c53592d2364242099cedd8580f6af40d'} {{(pid=132399) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 06:41:23.271797 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:23.272263 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:23.272686 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:23.273394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:23.273839 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:23.274260 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:23.360733 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.multi_cell_list [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132399) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 06:41:23.464763 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a4355c38-6600-439f-bbff-efcd03880906 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208375 Sep 13 06:41:23.465335 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 238/468] 10.222.0.17 () {58 vars in 1125 bytes} [Tue Sep 13 06:41:23 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:41:23.476908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fcf35fa4-ff4e-4b00-8f12-5f83d1964ca6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:23.478374 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fcf35fa4-ff4e-4b00-8f12-5f83d1964ca6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:23.484153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fcf35fa4-ff4e-4b00-8f12-5f83d1964ca6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:23.484629 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fcf35fa4-ff4e-4b00-8f12-5f83d1964ca6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:23.485059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fcf35fa4-ff4e-4b00-8f12-5f83d1964ca6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:23.485736 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fcf35fa4-ff4e-4b00-8f12-5f83d1964ca6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:23.486185 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fcf35fa4-ff4e-4b00-8f12-5f83d1964ca6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:23.486601 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fcf35fa4-ff4e-4b00-8f12-5f83d1964ca6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:23.619277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fcf35fa4-ff4e-4b00-8f12-5f83d1964ca6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:23.630182 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fcf35fa4-ff4e-4b00-8f12-5f83d1964ca6 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1548 microversion: 2.1 time: 0.156975 Sep 13 06:41:23.630761 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 231/469] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:23 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:24.357793 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-318d36ee-d01e-4a74-89c7-a3f25514beb4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:24.363667 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-318d36ee-d01e-4a74-89c7-a3f25514beb4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:24.364145 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-318d36ee-d01e-4a74-89c7-a3f25514beb4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:24.364571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-318d36ee-d01e-4a74-89c7-a3f25514beb4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:24.423366 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-318d36ee-d01e-4a74-89c7-a3f25514beb4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Going to try to stop instance {{(pid=132399) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 06:41:24.466094 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-318d36ee-d01e-4a74-89c7-a3f25514beb4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/action" status: 202 len: 0 microversion: 2.1 time: 0.112405 Sep 13 06:41:24.466687 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 239/470] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:41:24 2022] POST /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:41:24.474986 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-89a6aa83-f785-4fda-951d-91f18245cb5a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:24.475452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-89a6aa83-f785-4fda-951d-91f18245cb5a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:24.481665 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-89a6aa83-f785-4fda-951d-91f18245cb5a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:24.482330 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-89a6aa83-f785-4fda-951d-91f18245cb5a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:24.482768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-89a6aa83-f785-4fda-951d-91f18245cb5a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:24.483495 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-89a6aa83-f785-4fda-951d-91f18245cb5a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:24.483961 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-89a6aa83-f785-4fda-951d-91f18245cb5a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:24.484381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-89a6aa83-f785-4fda-951d-91f18245cb5a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:24.616988 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-89a6aa83-f785-4fda-951d-91f18245cb5a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:24.625836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-89a6aa83-f785-4fda-951d-91f18245cb5a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.154774 Sep 13 06:41:24.626419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 232/471] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:24 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:25.215241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-da5a4a7c-b923-4cc2-82c6-6d2b3b11de88 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52db33f3-c15a-435f-a2ae-274a14581946"}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:25.217739 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-da5a4a7c-b923-4cc2-82c6-6d2b3b11de88 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:25.223993 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da5a4a7c-b923-4cc2-82c6-6d2b3b11de88 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:25.224480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da5a4a7c-b923-4cc2-82c6-6d2b3b11de88 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:25.224980 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da5a4a7c-b923-4cc2-82c6-6d2b3b11de88 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:25.226001 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da5a4a7c-b923-4cc2-82c6-6d2b3b11de88 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:25.226457 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da5a4a7c-b923-4cc2-82c6-6d2b3b11de88 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:25.226874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-da5a4a7c-b923-4cc2-82c6-6d2b3b11de88 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:25.416571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:25.545543 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-da5a4a7c-b923-4cc2-82c6-6d2b3b11de88 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "POST /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335563 Sep 13 06:41:25.550258 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 240/472] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:41:25 2022] POST /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:41:25.648906 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-780b4ad8-19f2-4338-b12f-6c4caa9cd1d2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:25.650522 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-780b4ad8-19f2-4338-b12f-6c4caa9cd1d2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:25.656790 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-780b4ad8-19f2-4338-b12f-6c4caa9cd1d2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:25.658116 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-780b4ad8-19f2-4338-b12f-6c4caa9cd1d2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:25.659938 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-780b4ad8-19f2-4338-b12f-6c4caa9cd1d2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:25.660900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-780b4ad8-19f2-4338-b12f-6c4caa9cd1d2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:25.661330 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-780b4ad8-19f2-4338-b12f-6c4caa9cd1d2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:25.661744 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-780b4ad8-19f2-4338-b12f-6c4caa9cd1d2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:25.825622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-780b4ad8-19f2-4338-b12f-6c4caa9cd1d2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:25.833836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-780b4ad8-19f2-4338-b12f-6c4caa9cd1d2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.188753 Sep 13 06:41:25.834413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 233/473] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:25 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:26.856801 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-86858888-05ad-4ebd-b6aa-4e5b68572607 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:26.857511 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-86858888-05ad-4ebd-b6aa-4e5b68572607 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:26.864309 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86858888-05ad-4ebd-b6aa-4e5b68572607 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:26.864790 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86858888-05ad-4ebd-b6aa-4e5b68572607 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:26.865446 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86858888-05ad-4ebd-b6aa-4e5b68572607 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:26.866351 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86858888-05ad-4ebd-b6aa-4e5b68572607 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:26.866807 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86858888-05ad-4ebd-b6aa-4e5b68572607 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:26.867406 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86858888-05ad-4ebd-b6aa-4e5b68572607 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:27.013652 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-86858888-05ad-4ebd-b6aa-4e5b68572607 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:27.021836 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-86858888-05ad-4ebd-b6aa-4e5b68572607 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.169241 Sep 13 06:41:27.022396 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 241/474] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:26 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:28.046487 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-85b1ede2-f4e5-497f-b315-d0d90b16a01d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:28.047092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-85b1ede2-f4e5-497f-b315-d0d90b16a01d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:28.049600 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=54 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:28.054950 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-85b1ede2-f4e5-497f-b315-d0d90b16a01d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:28.055469 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-85b1ede2-f4e5-497f-b315-d0d90b16a01d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:28.055933 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-85b1ede2-f4e5-497f-b315-d0d90b16a01d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:28.056631 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-85b1ede2-f4e5-497f-b315-d0d90b16a01d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:28.057089 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-85b1ede2-f4e5-497f-b315-d0d90b16a01d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:28.057517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-85b1ede2-f4e5-497f-b315-d0d90b16a01d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:28.257857 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-85b1ede2-f4e5-497f-b315-d0d90b16a01d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:28.266769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-85b1ede2-f4e5-497f-b315-d0d90b16a01d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.224228 Sep 13 06:41:28.267428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 234/475] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:28 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:29.291742 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-191eb8a8-ec1d-4e24-8def-b3f14605f979 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:29.292293 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-191eb8a8-ec1d-4e24-8def-b3f14605f979 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:29.295047 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=56 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:29.301699 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-191eb8a8-ec1d-4e24-8def-b3f14605f979 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:29.302214 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-191eb8a8-ec1d-4e24-8def-b3f14605f979 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:29.302952 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-191eb8a8-ec1d-4e24-8def-b3f14605f979 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:29.304145 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-191eb8a8-ec1d-4e24-8def-b3f14605f979 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:29.304631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-191eb8a8-ec1d-4e24-8def-b3f14605f979 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:29.305052 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-191eb8a8-ec1d-4e24-8def-b3f14605f979 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:29.436113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-191eb8a8-ec1d-4e24-8def-b3f14605f979 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:29.444267 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-191eb8a8-ec1d-4e24-8def-b3f14605f979 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.156725 Sep 13 06:41:29.444821 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 242/476] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:29 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:29.919390 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1643065580", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "networks": [{"uuid": "ef28f84e-f778-4ee4-8f82-1c442023ec33"}]}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:29.973478 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] validate_networks() for [('ef28f84e-f778-4ee4-8f82-1c442023ec33', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:41:30.314988 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:41:30.315460 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:41:30.315939 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:41:30.316374 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:41:30.316810 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:41:30.327573 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:30.328716 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:30.329176 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:30.330503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:30.331167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:30.331626 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:30.348334 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Getting quotas for project 5140d3b3124d4fbbb3859a597710cf48. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:41:30.352268 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Getting quotas for user 4250279832584ec4a77ce899e850b848 and project 5140d3b3124d4fbbb3859a597710cf48. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:41:30.362879 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:41:30.365186 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:41:30.410758 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c2b29390-d8cc-4be0-972e-e16d1d380860 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495976 Sep 13 06:41:30.411443 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 235/477] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:41:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:41:30.422663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0a5f03ef-26fe-4436-a299-13d3e65d17bd tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:30.423322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0a5f03ef-26fe-4436-a299-13d3e65d17bd tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:30.467041 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f9f7a52f-0e45-4e67-8341-3de538ba36a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:30.468031 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f9f7a52f-0e45-4e67-8341-3de538ba36a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:30.474198 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f9f7a52f-0e45-4e67-8341-3de538ba36a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:30.475427 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f9f7a52f-0e45-4e67-8341-3de538ba36a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:30.476031 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f9f7a52f-0e45-4e67-8341-3de538ba36a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:30.476733 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f9f7a52f-0e45-4e67-8341-3de538ba36a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:30.477205 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f9f7a52f-0e45-4e67-8341-3de538ba36a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:30.477504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0a5f03ef-26fe-4436-a299-13d3e65d17bd tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:30.477653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f9f7a52f-0e45-4e67-8341-3de538ba36a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:30.485692 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0a5f03ef-26fe-4436-a299-13d3e65d17bd tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1219 microversion: 2.1 time: 0.066880 Sep 13 06:41:30.486638 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 243/478] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:30 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:30.639087 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f9f7a52f-0e45-4e67-8341-3de538ba36a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:30.650400 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f9f7a52f-0e45-4e67-8341-3de538ba36a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.187166 Sep 13 06:41:30.651078 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 236/479] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:30 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:31.511000 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8aebc489-52f7-479c-8158-c37d2eed2de0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:31.511613 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8aebc489-52f7-479c-8158-c37d2eed2de0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:31.518378 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8aebc489-52f7-479c-8158-c37d2eed2de0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:31.518852 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8aebc489-52f7-479c-8158-c37d2eed2de0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:31.519279 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8aebc489-52f7-479c-8158-c37d2eed2de0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:31.519994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8aebc489-52f7-479c-8158-c37d2eed2de0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:31.520445 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8aebc489-52f7-479c-8158-c37d2eed2de0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:31.520861 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8aebc489-52f7-479c-8158-c37d2eed2de0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:31.580768 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8aebc489-52f7-479c-8158-c37d2eed2de0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:31.588991 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8aebc489-52f7-479c-8158-c37d2eed2de0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1271 microversion: 2.1 time: 0.082409 Sep 13 06:41:31.589551 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 244/480] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:31 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:31.673444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e5e58560-22e9-46bf-94b4-b4a78190eda3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:31.674049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e5e58560-22e9-46bf-94b4-b4a78190eda3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:31.681048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5e58560-22e9-46bf-94b4-b4a78190eda3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:31.681386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5e58560-22e9-46bf-94b4-b4a78190eda3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:31.681819 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5e58560-22e9-46bf-94b4-b4a78190eda3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:31.682696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5e58560-22e9-46bf-94b4-b4a78190eda3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:31.683176 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5e58560-22e9-46bf-94b4-b4a78190eda3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:31.683631 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5e58560-22e9-46bf-94b4-b4a78190eda3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:31.817620 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e5e58560-22e9-46bf-94b4-b4a78190eda3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:31.826492 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e5e58560-22e9-46bf-94b4-b4a78190eda3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.156859 Sep 13 06:41:31.827086 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 237/481] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:31 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:32.611131 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-11545290-0a4c-45e3-aa8b-9afbdd6e2b59 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:32.612273 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-11545290-0a4c-45e3-aa8b-9afbdd6e2b59 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:32.618777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11545290-0a4c-45e3-aa8b-9afbdd6e2b59 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:32.619254 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11545290-0a4c-45e3-aa8b-9afbdd6e2b59 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:32.619712 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11545290-0a4c-45e3-aa8b-9afbdd6e2b59 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:32.620405 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11545290-0a4c-45e3-aa8b-9afbdd6e2b59 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:32.620857 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11545290-0a4c-45e3-aa8b-9afbdd6e2b59 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:32.621282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11545290-0a4c-45e3-aa8b-9afbdd6e2b59 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:32.698897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-11545290-0a4c-45e3-aa8b-9afbdd6e2b59 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:32.721121 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-11545290-0a4c-45e3-aa8b-9afbdd6e2b59 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1279 microversion: 2.1 time: 0.114053 Sep 13 06:41:32.721724 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 245/482] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:32 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1279 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:32.849651 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-cf1e5796-8e14-48b7-9977-d7b8087ab6a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:32.850177 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-cf1e5796-8e14-48b7-9977-d7b8087ab6a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:32.856448 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cf1e5796-8e14-48b7-9977-d7b8087ab6a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:32.856927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cf1e5796-8e14-48b7-9977-d7b8087ab6a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:32.857356 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cf1e5796-8e14-48b7-9977-d7b8087ab6a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:32.858037 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cf1e5796-8e14-48b7-9977-d7b8087ab6a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:32.858484 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cf1e5796-8e14-48b7-9977-d7b8087ab6a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:32.858900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cf1e5796-8e14-48b7-9977-d7b8087ab6a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:32.985453 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-cf1e5796-8e14-48b7-9977-d7b8087ab6a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:32.993840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-cf1e5796-8e14-48b7-9977-d7b8087ab6a8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.148058 Sep 13 06:41:32.994410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 238/483] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:32 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:33.745327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a6004faf-50df-4f6e-910d-834244fe26a3 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:33.745938 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a6004faf-50df-4f6e-910d-834244fe26a3 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:33.747856 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:33.756533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a6004faf-50df-4f6e-910d-834244fe26a3 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:33.757692 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a6004faf-50df-4f6e-910d-834244fe26a3 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:33.758137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a6004faf-50df-4f6e-910d-834244fe26a3 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:33.758846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a6004faf-50df-4f6e-910d-834244fe26a3 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:33.759307 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a6004faf-50df-4f6e-910d-834244fe26a3 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:33.759763 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a6004faf-50df-4f6e-910d-834244fe26a3 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:33.955262 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a6004faf-50df-4f6e-910d-834244fe26a3 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:33.963626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a6004faf-50df-4f6e-910d-834244fe26a3 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1319 microversion: 2.1 time: 0.223382 Sep 13 06:41:33.964478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 246/484] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:33 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:34.017519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b938c004-6e28-4fff-b8ae-3eb609de6103 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:34.018074 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b938c004-6e28-4fff-b8ae-3eb609de6103 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:34.024867 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b938c004-6e28-4fff-b8ae-3eb609de6103 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:34.025356 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b938c004-6e28-4fff-b8ae-3eb609de6103 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:34.025790 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b938c004-6e28-4fff-b8ae-3eb609de6103 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:34.026487 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b938c004-6e28-4fff-b8ae-3eb609de6103 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:34.026942 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b938c004-6e28-4fff-b8ae-3eb609de6103 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:34.028030 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b938c004-6e28-4fff-b8ae-3eb609de6103 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:34.173413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b938c004-6e28-4fff-b8ae-3eb609de6103 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:34.182605 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b938c004-6e28-4fff-b8ae-3eb609de6103 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.168929 Sep 13 06:41:34.183259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 239/485] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:34 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:34.238812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3b310fe7-6b85-4d08-8226-693097090399 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:34.239434 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3b310fe7-6b85-4d08-8226-693097090399 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:34.245321 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b310fe7-6b85-4d08-8226-693097090399 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:34.245985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b310fe7-6b85-4d08-8226-693097090399 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:34.246414 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b310fe7-6b85-4d08-8226-693097090399 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:34.247096 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b310fe7-6b85-4d08-8226-693097090399 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:34.247736 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b310fe7-6b85-4d08-8226-693097090399 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:34.248154 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3b310fe7-6b85-4d08-8226-693097090399 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:34.475333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3b310fe7-6b85-4d08-8226-693097090399 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:34.483455 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3b310fe7-6b85-4d08-8226-693097090399 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1594 microversion: 2.1 time: 0.248699 Sep 13 06:41:34.484109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 247/486] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:34 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1594 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:34.629100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-0596f43c-aeba-4d95-83a6-ece1f06204a0 req-ee22db65-33c5-4c6a-bc26-c95f3d991f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa1c0546-fd2a-4a23-8e5b-3648d391b197", "tag": "b8415a51-f633-47b3-9f8d-1ff75aacfa40"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:34.642912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-0596f43c-aeba-4d95-83a6-ece1f06204a0 req-ee22db65-33c5-4c6a-bc26-c95f3d991f9b service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:34.644486 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-0596f43c-aeba-4d95-83a6-ece1f06204a0 req-ee22db65-33c5-4c6a-bc26-c95f3d991f9b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:34.644959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-0596f43c-aeba-4d95-83a6-ece1f06204a0 req-ee22db65-33c5-4c6a-bc26-c95f3d991f9b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:34.662490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-0596f43c-aeba-4d95-83a6-ece1f06204a0 req-ee22db65-33c5-4c6a-bc26-c95f3d991f9b service nova] Creating event network-changed:b8415a51-f633-47b3-9f8d-1ff75aacfa40 for instance aa1c0546-fd2a-4a23-8e5b-3648d391b197 on hv-cinder-85638 Sep 13 06:41:34.669611 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-0596f43c-aeba-4d95-83a6-ece1f06204a0 req-ee22db65-33c5-4c6a-bc26-c95f3d991f9b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043190 Sep 13 06:41:34.671093 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 240/487] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:41:34.988208 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8208e27c-a47a-46bb-ad67-9e2896035fec tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:34.988827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8208e27c-a47a-46bb-ad67-9e2896035fec tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:34.996608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8208e27c-a47a-46bb-ad67-9e2896035fec tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:34.997096 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8208e27c-a47a-46bb-ad67-9e2896035fec tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:34.997657 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8208e27c-a47a-46bb-ad67-9e2896035fec tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:34.998354 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8208e27c-a47a-46bb-ad67-9e2896035fec tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:34.998806 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8208e27c-a47a-46bb-ad67-9e2896035fec tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:34.999223 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8208e27c-a47a-46bb-ad67-9e2896035fec tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:35.204885 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8208e27c-a47a-46bb-ad67-9e2896035fec tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:35.209339 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ac53f142-c0d1-475e-8cca-25743a43d5c3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:35.211863 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ac53f142-c0d1-475e-8cca-25743a43d5c3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:35.214277 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8208e27c-a47a-46bb-ad67-9e2896035fec tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1319 microversion: 2.1 time: 0.231133 Sep 13 06:41:35.215418 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 248/488] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:34 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:35.224844 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ac53f142-c0d1-475e-8cca-25743a43d5c3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:35.225652 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ac53f142-c0d1-475e-8cca-25743a43d5c3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:35.226252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ac53f142-c0d1-475e-8cca-25743a43d5c3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:35.227822 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ac53f142-c0d1-475e-8cca-25743a43d5c3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:35.228514 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ac53f142-c0d1-475e-8cca-25743a43d5c3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:35.229263 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ac53f142-c0d1-475e-8cca-25743a43d5c3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:35.517978 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ac53f142-c0d1-475e-8cca-25743a43d5c3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:35.526665 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ac53f142-c0d1-475e-8cca-25743a43d5c3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.323509 Sep 13 06:41:35.527239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 241/489] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:35 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:36.237912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-06c7b557-3192-4764-8608-827c13e3e811 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:36.238514 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-06c7b557-3192-4764-8608-827c13e3e811 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:36.244762 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06c7b557-3192-4764-8608-827c13e3e811 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:36.245236 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06c7b557-3192-4764-8608-827c13e3e811 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:36.245660 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06c7b557-3192-4764-8608-827c13e3e811 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:36.246345 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06c7b557-3192-4764-8608-827c13e3e811 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:36.246855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06c7b557-3192-4764-8608-827c13e3e811 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:36.247274 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06c7b557-3192-4764-8608-827c13e3e811 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:36.376022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-06c7b557-3192-4764-8608-827c13e3e811 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:36.383565 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-06c7b557-3192-4764-8608-827c13e3e811 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1319 microversion: 2.1 time: 0.149417 Sep 13 06:41:36.384123 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 249/490] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:36 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:36.550778 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-34bf01df-a360-4427-9c6a-a198a0501f76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:36.551399 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-34bf01df-a360-4427-9c6a-a198a0501f76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:36.558046 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34bf01df-a360-4427-9c6a-a198a0501f76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:36.558674 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34bf01df-a360-4427-9c6a-a198a0501f76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:36.559325 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34bf01df-a360-4427-9c6a-a198a0501f76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:36.560116 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34bf01df-a360-4427-9c6a-a198a0501f76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:36.560723 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34bf01df-a360-4427-9c6a-a198a0501f76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:36.561253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-34bf01df-a360-4427-9c6a-a198a0501f76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:36.567095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:36.665715 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-6c5996a3-af6e-40d5-b05c-775599cc0f1e req-fec5daa9-5491-43a3-94c8-0120839c5f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b451b5fc-70f0-4e75-b74a-c839fc998e38", "tag": "a7742d75-3c78-40a9-8666-a3fc8f3dbe52"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:36.674935 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-6c5996a3-af6e-40d5-b05c-775599cc0f1e req-fec5daa9-5491-43a3-94c8-0120839c5f32 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:36.675641 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-6c5996a3-af6e-40d5-b05c-775599cc0f1e req-fec5daa9-5491-43a3-94c8-0120839c5f32 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:36.676217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-6c5996a3-af6e-40d5-b05c-775599cc0f1e req-fec5daa9-5491-43a3-94c8-0120839c5f32 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:36.690210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-6c5996a3-af6e-40d5-b05c-775599cc0f1e req-fec5daa9-5491-43a3-94c8-0120839c5f32 service nova] Creating event network-changed:a7742d75-3c78-40a9-8666-a3fc8f3dbe52 for instance b451b5fc-70f0-4e75-b74a-c839fc998e38 on hv-cinder-85638 Sep 13 06:41:36.697736 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-6c5996a3-af6e-40d5-b05c-775599cc0f1e req-fec5daa9-5491-43a3-94c8-0120839c5f32 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035542 Sep 13 06:41:36.698553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 250/491] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:41:36.739677 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-34bf01df-a360-4427-9c6a-a198a0501f76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:36.748967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-34bf01df-a360-4427-9c6a-a198a0501f76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.201936 Sep 13 06:41:36.750376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 242/492] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:36 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:37.407667 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e8b60c8e-7a38-4d2c-b84b-248894470032 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:37.408644 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e8b60c8e-7a38-4d2c-b84b-248894470032 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:37.416074 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e8b60c8e-7a38-4d2c-b84b-248894470032 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:37.416563 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e8b60c8e-7a38-4d2c-b84b-248894470032 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:37.417176 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e8b60c8e-7a38-4d2c-b84b-248894470032 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:37.418061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e8b60c8e-7a38-4d2c-b84b-248894470032 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:37.418675 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e8b60c8e-7a38-4d2c-b84b-248894470032 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:37.419114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e8b60c8e-7a38-4d2c-b84b-248894470032 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:37.588072 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e8b60c8e-7a38-4d2c-b84b-248894470032 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:37.596607 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e8b60c8e-7a38-4d2c-b84b-248894470032 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1319 microversion: 2.1 time: 0.193921 Sep 13 06:41:37.597184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 251/493] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:37 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:37.669844 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f8a7bf99-0339-4c11-9230-072fa85b341a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1772654701"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:37.670457 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f8a7bf99-0339-4c11-9230-072fa85b341a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:37.677082 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8a7bf99-0339-4c11-9230-072fa85b341a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:37.677668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8a7bf99-0339-4c11-9230-072fa85b341a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:37.678092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8a7bf99-0339-4c11-9230-072fa85b341a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:37.678795 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8a7bf99-0339-4c11-9230-072fa85b341a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:37.679259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8a7bf99-0339-4c11-9230-072fa85b341a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:37.679730 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8a7bf99-0339-4c11-9230-072fa85b341a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:37.772887 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-765ce087-4bf6-4538-8549-42f2b4e6d5a3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:37.773780 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-765ce087-4bf6-4538-8549-42f2b4e6d5a3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:37.780286 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-765ce087-4bf6-4538-8549-42f2b4e6d5a3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:37.780925 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-765ce087-4bf6-4538-8549-42f2b4e6d5a3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:37.781362 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-765ce087-4bf6-4538-8549-42f2b4e6d5a3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:37.782055 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-765ce087-4bf6-4538-8549-42f2b4e6d5a3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:37.782553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-765ce087-4bf6-4538-8549-42f2b4e6d5a3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:37.782980 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-765ce087-4bf6-4538-8549-42f2b4e6d5a3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:37.815954 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.network.security_group_api [None req-f8a7bf99-0339-4c11-9230-072fa85b341a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Adding security group 42365a9b-062e-4658-b1ef-922e7f59526f to port a7742d75-3c78-40a9-8666-a3fc8f3dbe52 Sep 13 06:41:37.922634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-765ce087-4bf6-4538-8549-42f2b4e6d5a3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:37.932000 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-765ce087-4bf6-4538-8549-42f2b4e6d5a3 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.163238 Sep 13 06:41:37.932684 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 252/494] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:37 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:38.156546 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f8a7bf99-0339-4c11-9230-072fa85b341a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "POST /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/action" status: 202 len: 0 microversion: 2.1 time: 0.490614 Sep 13 06:41:38.157195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 243/495] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:41:37 2022] POST /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:41:38.166126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-51ab731d-0f7c-4812-a4df-1924fe8221ec tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:38.166756 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-51ab731d-0f7c-4812-a4df-1924fe8221ec tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:38.172678 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51ab731d-0f7c-4812-a4df-1924fe8221ec tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:38.173160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51ab731d-0f7c-4812-a4df-1924fe8221ec tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:38.173592 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51ab731d-0f7c-4812-a4df-1924fe8221ec tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:38.174277 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51ab731d-0f7c-4812-a4df-1924fe8221ec tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:38.174729 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51ab731d-0f7c-4812-a4df-1924fe8221ec tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:38.175812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-51ab731d-0f7c-4812-a4df-1924fe8221ec tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:38.331812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-51ab731d-0f7c-4812-a4df-1924fe8221ec tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:38.340255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-51ab731d-0f7c-4812-a4df-1924fe8221ec tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1641 microversion: 2.1 time: 0.178655 Sep 13 06:41:38.340902 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 253/496] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:38 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1641 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:38.620537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a5201f8e-ca5c-4854-8ac3-86e6ec78de0f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:38.621540 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a5201f8e-ca5c-4854-8ac3-86e6ec78de0f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:38.628040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a5201f8e-ca5c-4854-8ac3-86e6ec78de0f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:38.628898 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a5201f8e-ca5c-4854-8ac3-86e6ec78de0f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:38.629560 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a5201f8e-ca5c-4854-8ac3-86e6ec78de0f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:38.630506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a5201f8e-ca5c-4854-8ac3-86e6ec78de0f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:38.631178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a5201f8e-ca5c-4854-8ac3-86e6ec78de0f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:38.631926 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a5201f8e-ca5c-4854-8ac3-86e6ec78de0f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:38.717567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-59fbb507-fe9c-4d54-9356-66a2c6934748 req-f874c924-ca7a-4bff-a0a1-75771c06944b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b451b5fc-70f0-4e75-b74a-c839fc998e38", "tag": "a7742d75-3c78-40a9-8666-a3fc8f3dbe52"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:38.730285 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-59fbb507-fe9c-4d54-9356-66a2c6934748 req-f874c924-ca7a-4bff-a0a1-75771c06944b service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:38.732000 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-59fbb507-fe9c-4d54-9356-66a2c6934748 req-f874c924-ca7a-4bff-a0a1-75771c06944b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:38.732619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-59fbb507-fe9c-4d54-9356-66a2c6934748 req-f874c924-ca7a-4bff-a0a1-75771c06944b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:38.749269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-59fbb507-fe9c-4d54-9356-66a2c6934748 req-f874c924-ca7a-4bff-a0a1-75771c06944b service nova] Creating event network-changed:a7742d75-3c78-40a9-8666-a3fc8f3dbe52 for instance b451b5fc-70f0-4e75-b74a-c839fc998e38 on hv-cinder-85638 Sep 13 06:41:38.754818 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-59fbb507-fe9c-4d54-9356-66a2c6934748 req-f874c924-ca7a-4bff-a0a1-75771c06944b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043073 Sep 13 06:41:38.756718 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 254/497] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:41:38.866424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a5201f8e-ca5c-4854-8ac3-86e6ec78de0f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:38.874889 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a5201f8e-ca5c-4854-8ac3-86e6ec78de0f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1319 microversion: 2.1 time: 0.258319 Sep 13 06:41:38.876463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 244/498] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:38 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:38.957393 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-40617673-a7a4-47d7-b5e8-9ccc6dcef786 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:38.958101 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-40617673-a7a4-47d7-b5e8-9ccc6dcef786 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:38.964794 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40617673-a7a4-47d7-b5e8-9ccc6dcef786 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:38.965282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40617673-a7a4-47d7-b5e8-9ccc6dcef786 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:38.965717 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40617673-a7a4-47d7-b5e8-9ccc6dcef786 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:38.966420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40617673-a7a4-47d7-b5e8-9ccc6dcef786 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:38.966875 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40617673-a7a4-47d7-b5e8-9ccc6dcef786 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:38.967298 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40617673-a7a4-47d7-b5e8-9ccc6dcef786 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:39.107302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-40617673-a7a4-47d7-b5e8-9ccc6dcef786 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:39.116410 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-40617673-a7a4-47d7-b5e8-9ccc6dcef786 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1723 microversion: 2.1 time: 0.163196 Sep 13 06:41:39.116982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 255/499] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:38 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:39.897695 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-dc43ee65-fe21-45a4-99ab-d522ecef587a tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:39.898310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-dc43ee65-fe21-45a4-99ab-d522ecef587a tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:39.905297 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc43ee65-fe21-45a4-99ab-d522ecef587a tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:39.905783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc43ee65-fe21-45a4-99ab-d522ecef587a tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:39.906220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc43ee65-fe21-45a4-99ab-d522ecef587a tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:39.906914 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc43ee65-fe21-45a4-99ab-d522ecef587a tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:39.907381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc43ee65-fe21-45a4-99ab-d522ecef587a tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:39.907900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc43ee65-fe21-45a4-99ab-d522ecef587a tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:40.051781 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dc43ee65-fe21-45a4-99ab-d522ecef587a tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:40.059834 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-dc43ee65-fe21-45a4-99ab-d522ecef587a tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1319 microversion: 2.1 time: 0.165937 Sep 13 06:41:40.060405 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 245/500] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:39 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:40.139668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d880e579-7a1c-42cb-bb75-ebd2cd6f3f83 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:40.140279 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d880e579-7a1c-42cb-bb75-ebd2cd6f3f83 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:40.146681 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d880e579-7a1c-42cb-bb75-ebd2cd6f3f83 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:40.147163 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d880e579-7a1c-42cb-bb75-ebd2cd6f3f83 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:40.147625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d880e579-7a1c-42cb-bb75-ebd2cd6f3f83 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:40.148323 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d880e579-7a1c-42cb-bb75-ebd2cd6f3f83 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:40.148787 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d880e579-7a1c-42cb-bb75-ebd2cd6f3f83 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:40.149715 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d880e579-7a1c-42cb-bb75-ebd2cd6f3f83 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:40.279005 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d880e579-7a1c-42cb-bb75-ebd2cd6f3f83 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:40.287195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d880e579-7a1c-42cb-bb75-ebd2cd6f3f83 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1700 microversion: 2.1 time: 0.151333 Sep 13 06:41:40.287774 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 256/501] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:40 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:40.310902 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2b8f4c7b-1a03-47bb-8b15-b6a5fb5c081d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:40.316879 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b8f4c7b-1a03-47bb-8b15-b6a5fb5c081d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:40.317354 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b8f4c7b-1a03-47bb-8b15-b6a5fb5c081d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:40.317784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b8f4c7b-1a03-47bb-8b15-b6a5fb5c081d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:40.343909 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:40.364959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=6 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:40.377478 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2b8f4c7b-1a03-47bb-8b15-b6a5fb5c081d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Going to try to start instance {{(pid=132398) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 06:41:40.422627 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2b8f4c7b-1a03-47bb-8b15-b6a5fb5c081d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/action" status: 202 len: 0 microversion: 2.1 time: 0.115299 Sep 13 06:41:40.423261 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 246/502] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:41:40 2022] POST /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:41:40.431564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-aa4e9d26-77ad-4d0c-b58e-95dc6ee33a4f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:40.432177 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-aa4e9d26-77ad-4d0c-b58e-95dc6ee33a4f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:40.438023 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-aa4e9d26-77ad-4d0c-b58e-95dc6ee33a4f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:40.438511 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-aa4e9d26-77ad-4d0c-b58e-95dc6ee33a4f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:40.439010 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-aa4e9d26-77ad-4d0c-b58e-95dc6ee33a4f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:40.439687 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-aa4e9d26-77ad-4d0c-b58e-95dc6ee33a4f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:40.440149 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-aa4e9d26-77ad-4d0c-b58e-95dc6ee33a4f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:40.440628 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-aa4e9d26-77ad-4d0c-b58e-95dc6ee33a4f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:40.485117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:40.571569 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-aa4e9d26-77ad-4d0c-b58e-95dc6ee33a4f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:40.579822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-aa4e9d26-77ad-4d0c-b58e-95dc6ee33a4f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1709 microversion: 2.1 time: 0.152018 Sep 13 06:41:40.580707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 257/503] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:40 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:41.083235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-31f058ec-594c-4ad6-a691-af92180bc42e tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:41.083972 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-31f058ec-594c-4ad6-a691-af92180bc42e tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:41.090106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31f058ec-594c-4ad6-a691-af92180bc42e tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:41.090595 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31f058ec-594c-4ad6-a691-af92180bc42e tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:41.091039 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31f058ec-594c-4ad6-a691-af92180bc42e tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:41.091772 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31f058ec-594c-4ad6-a691-af92180bc42e tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:41.092232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31f058ec-594c-4ad6-a691-af92180bc42e tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:41.092659 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31f058ec-594c-4ad6-a691-af92180bc42e tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:41.224573 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-31f058ec-594c-4ad6-a691-af92180bc42e tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:41.232395 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-31f058ec-594c-4ad6-a691-af92180bc42e tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1319 microversion: 2.1 time: 0.153960 Sep 13 06:41:41.233048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 247/504] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:41 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:41.604053 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-453cb370-b0c8-4fa8-a333-70e27e41626b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:41.604688 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-453cb370-b0c8-4fa8-a333-70e27e41626b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:41.611028 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-453cb370-b0c8-4fa8-a333-70e27e41626b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:41.611547 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-453cb370-b0c8-4fa8-a333-70e27e41626b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:41.611983 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-453cb370-b0c8-4fa8-a333-70e27e41626b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:41.612663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-453cb370-b0c8-4fa8-a333-70e27e41626b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:41.613117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-453cb370-b0c8-4fa8-a333-70e27e41626b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:41.613532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-453cb370-b0c8-4fa8-a333-70e27e41626b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:41.744378 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-453cb370-b0c8-4fa8-a333-70e27e41626b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:41.746532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:41.753630 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-453cb370-b0c8-4fa8-a333-70e27e41626b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1709 microversion: 2.1 time: 0.153500 Sep 13 06:41:41.754201 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 258/505] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:41 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:42.254114 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6886dcf0-e738-4691-b6bd-23f8b16c7d03 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:42.254720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6886dcf0-e738-4691-b6bd-23f8b16c7d03 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:42.261670 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6886dcf0-e738-4691-b6bd-23f8b16c7d03 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:42.262152 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6886dcf0-e738-4691-b6bd-23f8b16c7d03 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:42.262583 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6886dcf0-e738-4691-b6bd-23f8b16c7d03 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:42.263270 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6886dcf0-e738-4691-b6bd-23f8b16c7d03 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:42.263746 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6886dcf0-e738-4691-b6bd-23f8b16c7d03 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:42.264166 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6886dcf0-e738-4691-b6bd-23f8b16c7d03 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:42.278985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-8df227a6-8316-4cab-99ab-ee896c3313a8 req-cb3acd26-2580-4a22-b8b8-558726836c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa1c0546-fd2a-4a23-8e5b-3648d391b197", "name": "network-vif-plugged", "status": "completed", "tag": "b8415a51-f633-47b3-9f8d-1ff75aacfa40"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:42.290769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-8df227a6-8316-4cab-99ab-ee896c3313a8 req-cb3acd26-2580-4a22-b8b8-558726836c4b service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:42.290769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-8df227a6-8316-4cab-99ab-ee896c3313a8 req-cb3acd26-2580-4a22-b8b8-558726836c4b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:42.291394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-8df227a6-8316-4cab-99ab-ee896c3313a8 req-cb3acd26-2580-4a22-b8b8-558726836c4b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:42.304671 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-8df227a6-8316-4cab-99ab-ee896c3313a8 req-cb3acd26-2580-4a22-b8b8-558726836c4b service nova] Creating event network-vif-plugged:b8415a51-f633-47b3-9f8d-1ff75aacfa40 for instance aa1c0546-fd2a-4a23-8e5b-3648d391b197 on hv-cinder-85638 Sep 13 06:41:42.310187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-8df227a6-8316-4cab-99ab-ee896c3313a8 req-cb3acd26-2580-4a22-b8b8-558726836c4b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034779 Sep 13 06:41:42.310971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 259/506] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:41:42.417178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6886dcf0-e738-4691-b6bd-23f8b16c7d03 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:42.424821 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6886dcf0-e738-4691-b6bd-23f8b16c7d03 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1319 microversion: 2.1 time: 0.174670 Sep 13 06:41:42.425381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 248/507] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:42 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:41:42.778115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-80a156b3-aba0-4bfa-97fc-934242710ed4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:42.779427 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-80a156b3-aba0-4bfa-97fc-934242710ed4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:42.786676 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80a156b3-aba0-4bfa-97fc-934242710ed4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:42.787157 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80a156b3-aba0-4bfa-97fc-934242710ed4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:42.787618 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80a156b3-aba0-4bfa-97fc-934242710ed4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:42.788308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80a156b3-aba0-4bfa-97fc-934242710ed4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:42.788759 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80a156b3-aba0-4bfa-97fc-934242710ed4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:42.789174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80a156b3-aba0-4bfa-97fc-934242710ed4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:42.926412 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-80a156b3-aba0-4bfa-97fc-934242710ed4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:42.935012 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-80a156b3-aba0-4bfa-97fc-934242710ed4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1713 microversion: 2.1 time: 0.161821 Sep 13 06:41:42.935608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 260/508] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:42 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1713 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:43.448303 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a0e4885a-a9f9-42cb-bb99-6673181820c2 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:43.448910 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a0e4885a-a9f9-42cb-bb99-6673181820c2 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:43.455319 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0e4885a-a9f9-42cb-bb99-6673181820c2 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:43.455832 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0e4885a-a9f9-42cb-bb99-6673181820c2 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:43.456272 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0e4885a-a9f9-42cb-bb99-6673181820c2 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:43.456958 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0e4885a-a9f9-42cb-bb99-6673181820c2 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:43.457413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0e4885a-a9f9-42cb-bb99-6673181820c2 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:43.457834 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0e4885a-a9f9-42cb-bb99-6673181820c2 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:43.586903 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a0e4885a-a9f9-42cb-bb99-6673181820c2 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:43.594351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a0e4885a-a9f9-42cb-bb99-6673181820c2 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1319 microversion: 2.1 time: 0.150347 Sep 13 06:41:43.594919 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 249/509] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:43 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:44.616518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d5285a8f-a9c9-48cf-a335-adc6bb51ff37 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:44.617120 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d5285a8f-a9c9-48cf-a335-adc6bb51ff37 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:44.623993 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5285a8f-a9c9-48cf-a335-adc6bb51ff37 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:44.624462 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5285a8f-a9c9-48cf-a335-adc6bb51ff37 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:44.624885 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5285a8f-a9c9-48cf-a335-adc6bb51ff37 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:44.625554 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5285a8f-a9c9-48cf-a335-adc6bb51ff37 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:44.625996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5285a8f-a9c9-48cf-a335-adc6bb51ff37 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:44.626412 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5285a8f-a9c9-48cf-a335-adc6bb51ff37 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:44.761064 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d5285a8f-a9c9-48cf-a335-adc6bb51ff37 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:44.768716 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d5285a8f-a9c9-48cf-a335-adc6bb51ff37 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1319 microversion: 2.1 time: 0.155964 Sep 13 06:41:44.769277 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 261/510] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:44 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:44.932146 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-24d5a1f9-ded7-4bc5-942b-229eb8d6043b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:44.932689 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-24d5a1f9-ded7-4bc5-942b-229eb8d6043b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:44.939080 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24d5a1f9-ded7-4bc5-942b-229eb8d6043b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:44.939605 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24d5a1f9-ded7-4bc5-942b-229eb8d6043b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:44.940049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24d5a1f9-ded7-4bc5-942b-229eb8d6043b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:44.940739 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24d5a1f9-ded7-4bc5-942b-229eb8d6043b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:44.941218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24d5a1f9-ded7-4bc5-942b-229eb8d6043b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:44.941674 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24d5a1f9-ded7-4bc5-942b-229eb8d6043b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:44.964537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-24d5a1f9-ded7-4bc5-942b-229eb8d6043b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/ips" status: 200 len: 149 microversion: 2.1 time: 0.036855 Sep 13 06:41:44.965104 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 250/511] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Sep 13 06:41:44 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:41:45.790704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f87f6139-e3c8-4180-a525-113ec2088b6f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:45.791451 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f87f6139-e3c8-4180-a525-113ec2088b6f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:45.799313 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f87f6139-e3c8-4180-a525-113ec2088b6f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:45.799822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f87f6139-e3c8-4180-a525-113ec2088b6f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:45.800352 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f87f6139-e3c8-4180-a525-113ec2088b6f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:45.800924 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f87f6139-e3c8-4180-a525-113ec2088b6f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:45.801375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f87f6139-e3c8-4180-a525-113ec2088b6f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:45.801795 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f87f6139-e3c8-4180-a525-113ec2088b6f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:45.933036 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f87f6139-e3c8-4180-a525-113ec2088b6f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:45.941128 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f87f6139-e3c8-4180-a525-113ec2088b6f tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1507 microversion: 2.1 time: 0.154783 Sep 13 06:41:45.942520 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 262/512] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:45 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:46.352668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c8ba1870-5ee2-4432-8ea4-cf45d23f9fb7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bb7600d-f65e-40fd-8c41-0fec79ad2e35"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:46.368296 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c8ba1870-5ee2-4432-8ea4-cf45d23f9fb7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:46.374447 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c8ba1870-5ee2-4432-8ea4-cf45d23f9fb7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:46.374932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c8ba1870-5ee2-4432-8ea4-cf45d23f9fb7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:46.375378 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c8ba1870-5ee2-4432-8ea4-cf45d23f9fb7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:46.376167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c8ba1870-5ee2-4432-8ea4-cf45d23f9fb7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:46.376626 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c8ba1870-5ee2-4432-8ea4-cf45d23f9fb7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:46.377055 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c8ba1870-5ee2-4432-8ea4-cf45d23f9fb7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:46.682834 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c8ba1870-5ee2-4432-8ea4-cf45d23f9fb7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333948 Sep 13 06:41:46.683619 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 251/513] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:41:46 2022] POST /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:41:55.281154 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1c81b362-e285-4e7f-9824-be32ee76b6bd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: .version_select at 0x7fdc0d5a1550>, body: {"keypair": {"name": "tempest-keypair-2139874877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK9LbSXeY4wjEHFKn1/Vpg1hDpMy40CpuR7QonigrPscB6+ik7GfEUvC9i47nV1EVbyL5Nw0zHTHj2Vm03Dyw415E0l+36AVqaInp0LSVClOGmSZ+qNP1MejUe+i2yFhQ=="}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:55.298058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-1c81b362-e285-4e7f-9824-be32ee76b6bd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:41:55.302096 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-1c81b362-e285-4e7f-9824-be32ee76b6bd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for user cac2d22d853a4984b229911bde3a450b and project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:41:55.323964 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1c81b362-e285-4e7f-9824-be32ee76b6bd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046672 Sep 13 06:41:55.324559 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 263/514] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Sep 13 06:41:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:41:56.797317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:56.798022 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:56.803046 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-186891209", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "490d7309-ad3e-4bc6-9625-e6996e2b80d7"}], "security_groups": [{"name": "tempest-securitygroup--745635105"}], "key_name": "tempest-keypair-2139874877", "user_data": "}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:41:56.910591 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] validate_networks() for [('490d7309-ad3e-4bc6-9625-e6996e2b80d7', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:41:57.284064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:41:57.284493 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:41:57.284968 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:41:57.285380 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:41:57.285800 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:41:57.295542 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:57.295979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:57.296250 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:57.297082 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:57.297524 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:57.298017 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:57.315463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:41:57.319574 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for user cac2d22d853a4984b229911bde3a450b and project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:41:57.331073 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:41:57.333518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:41:57.381335 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e8ba7ce6-68c3-4752-bd97-3d80ce4d2c73 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.585604 Sep 13 06:41:57.381881 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 252/515] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:41:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:41:57.394084 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a5f8b5ef-3c89-47ba-89bd-bf0a8ff6d80f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:57.394694 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a5f8b5ef-3c89-47ba-89bd-bf0a8ff6d80f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:57.396706 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=21 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:57.455847 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a5f8b5ef-3c89-47ba-89bd-bf0a8ff6d80f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:57.465042 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a5f8b5ef-3c89-47ba-89bd-bf0a8ff6d80f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1241 microversion: 2.1 time: 0.075083 Sep 13 06:41:57.466133 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 264/516] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:57 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:58.489069 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2c4b11c1-482e-4833-92ba-fda478985f25 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:58.489679 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2c4b11c1-482e-4833-92ba-fda478985f25 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:58.496762 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c4b11c1-482e-4833-92ba-fda478985f25 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:58.497243 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c4b11c1-482e-4833-92ba-fda478985f25 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:58.497672 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c4b11c1-482e-4833-92ba-fda478985f25 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:58.498377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c4b11c1-482e-4833-92ba-fda478985f25 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:58.498853 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c4b11c1-482e-4833-92ba-fda478985f25 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:58.499267 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c4b11c1-482e-4833-92ba-fda478985f25 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:58.561934 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2c4b11c1-482e-4833-92ba-fda478985f25 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:58.569357 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2c4b11c1-482e-4833-92ba-fda478985f25 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1293 microversion: 2.1 time: 0.084552 Sep 13 06:41:58.569950 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 253/517] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:58 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:41:59.592524 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5ac47878-ea0b-44c1-9f9a-5b4880627430 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:41:59.593242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5ac47878-ea0b-44c1-9f9a-5b4880627430 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:41:59.596302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:59.601754 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ac47878-ea0b-44c1-9f9a-5b4880627430 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:59.602244 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ac47878-ea0b-44c1-9f9a-5b4880627430 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:59.602680 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ac47878-ea0b-44c1-9f9a-5b4880627430 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:59.603397 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ac47878-ea0b-44c1-9f9a-5b4880627430 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:41:59.604025 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ac47878-ea0b-44c1-9f9a-5b4880627430 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:41:59.604453 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ac47878-ea0b-44c1-9f9a-5b4880627430 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:41:59.763704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5ac47878-ea0b-44c1-9f9a-5b4880627430 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:41:59.771477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5ac47878-ea0b-44c1-9f9a-5b4880627430 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.183440 Sep 13 06:41:59.775006 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 265/518] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:41:59 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:00.418441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-40d05f75-56b4-404d-9fec-3bed997f8258 req-120ce7bd-5b70-4ca1-ba44-6b9756a5f331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9177caf-8489-4764-a082-2ac3fd7c23c6", "tag": "bdb184aa-5e29-4be4-8e1f-80f4a6c82812"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:42:00.429231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-40d05f75-56b4-404d-9fec-3bed997f8258 req-120ce7bd-5b70-4ca1-ba44-6b9756a5f331 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:00.429740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-40d05f75-56b4-404d-9fec-3bed997f8258 req-120ce7bd-5b70-4ca1-ba44-6b9756a5f331 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:00.430201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-40d05f75-56b4-404d-9fec-3bed997f8258 req-120ce7bd-5b70-4ca1-ba44-6b9756a5f331 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:00.442752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-40d05f75-56b4-404d-9fec-3bed997f8258 req-120ce7bd-5b70-4ca1-ba44-6b9756a5f331 service nova] Creating event network-changed:bdb184aa-5e29-4be4-8e1f-80f4a6c82812 for instance d9177caf-8489-4764-a082-2ac3fd7c23c6 on hv-cinder-85638 Sep 13 06:42:00.448356 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-40d05f75-56b4-404d-9fec-3bed997f8258 req-120ce7bd-5b70-4ca1-ba44-6b9756a5f331 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033859 Sep 13 06:42:00.449016 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 254/519] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:42:00.795649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7e7ee66f-d29d-43a3-885a-a52431cf374f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:00.796423 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7e7ee66f-d29d-43a3-885a-a52431cf374f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:00.803258 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e7ee66f-d29d-43a3-885a-a52431cf374f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:00.803781 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e7ee66f-d29d-43a3-885a-a52431cf374f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:00.804220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e7ee66f-d29d-43a3-885a-a52431cf374f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:00.804944 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e7ee66f-d29d-43a3-885a-a52431cf374f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:00.805400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e7ee66f-d29d-43a3-885a-a52431cf374f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:00.805826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e7ee66f-d29d-43a3-885a-a52431cf374f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:00.938342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7e7ee66f-d29d-43a3-885a-a52431cf374f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:00.946406 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7e7ee66f-d29d-43a3-885a-a52431cf374f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.154755 Sep 13 06:42:00.947100 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 266/520] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:00 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:01.970182 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5a20159b-ba61-457b-93bb-8a2a0e822dc7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:01.970883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5a20159b-ba61-457b-93bb-8a2a0e822dc7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:01.977161 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a20159b-ba61-457b-93bb-8a2a0e822dc7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:01.977639 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a20159b-ba61-457b-93bb-8a2a0e822dc7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:01.978595 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a20159b-ba61-457b-93bb-8a2a0e822dc7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:01.979320 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a20159b-ba61-457b-93bb-8a2a0e822dc7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:01.979809 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a20159b-ba61-457b-93bb-8a2a0e822dc7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:01.980232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a20159b-ba61-457b-93bb-8a2a0e822dc7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:02.112242 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5a20159b-ba61-457b-93bb-8a2a0e822dc7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:02.120861 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5a20159b-ba61-457b-93bb-8a2a0e822dc7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.155295 Sep 13 06:42:02.121429 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 255/521] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:01 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:03.142504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b9ed491b-30a6-4b1d-8fd1-36ea78d1353b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:03.143116 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b9ed491b-30a6-4b1d-8fd1-36ea78d1353b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:03.149564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9ed491b-30a6-4b1d-8fd1-36ea78d1353b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:03.150047 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9ed491b-30a6-4b1d-8fd1-36ea78d1353b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:03.150482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9ed491b-30a6-4b1d-8fd1-36ea78d1353b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:03.151209 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9ed491b-30a6-4b1d-8fd1-36ea78d1353b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:03.151713 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9ed491b-30a6-4b1d-8fd1-36ea78d1353b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:03.152160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9ed491b-30a6-4b1d-8fd1-36ea78d1353b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:03.282272 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b9ed491b-30a6-4b1d-8fd1-36ea78d1353b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:03.290007 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b9ed491b-30a6-4b1d-8fd1-36ea78d1353b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.151381 Sep 13 06:42:03.290570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 267/522] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:03 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:04.313856 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-afdc58cd-e6fd-4e17-bc23-9831e8bb6e1b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:04.314465 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-afdc58cd-e6fd-4e17-bc23-9831e8bb6e1b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:04.320782 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-afdc58cd-e6fd-4e17-bc23-9831e8bb6e1b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:04.321264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-afdc58cd-e6fd-4e17-bc23-9831e8bb6e1b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:04.322199 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-afdc58cd-e6fd-4e17-bc23-9831e8bb6e1b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:04.322888 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-afdc58cd-e6fd-4e17-bc23-9831e8bb6e1b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:04.323345 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-afdc58cd-e6fd-4e17-bc23-9831e8bb6e1b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:04.323792 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-afdc58cd-e6fd-4e17-bc23-9831e8bb6e1b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:04.452252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-afdc58cd-e6fd-4e17-bc23-9831e8bb6e1b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:04.459706 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-afdc58cd-e6fd-4e17-bc23-9831e8bb6e1b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.149644 Sep 13 06:42:04.460267 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 256/523] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:04 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:05.482624 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a87adf4d-57e8-4c6c-bc94-486d12bb698d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:05.483237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a87adf4d-57e8-4c6c-bc94-486d12bb698d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:05.489664 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a87adf4d-57e8-4c6c-bc94-486d12bb698d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:05.490151 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a87adf4d-57e8-4c6c-bc94-486d12bb698d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:05.490580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a87adf4d-57e8-4c6c-bc94-486d12bb698d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:05.491265 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a87adf4d-57e8-4c6c-bc94-486d12bb698d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:05.491741 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a87adf4d-57e8-4c6c-bc94-486d12bb698d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:05.492161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a87adf4d-57e8-4c6c-bc94-486d12bb698d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:05.618929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a87adf4d-57e8-4c6c-bc94-486d12bb698d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:05.626626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a87adf4d-57e8-4c6c-bc94-486d12bb698d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.147908 Sep 13 06:42:05.627189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 268/524] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:05 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:06.650544 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-95fd5cba-02d0-48d8-a697-e4c0c7610704 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:06.651080 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-95fd5cba-02d0-48d8-a697-e4c0c7610704 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:06.657438 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-95fd5cba-02d0-48d8-a697-e4c0c7610704 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:06.657912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-95fd5cba-02d0-48d8-a697-e4c0c7610704 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:06.658341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-95fd5cba-02d0-48d8-a697-e4c0c7610704 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:06.659020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-95fd5cba-02d0-48d8-a697-e4c0c7610704 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:06.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-95fd5cba-02d0-48d8-a697-e4c0c7610704 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:06.659927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-95fd5cba-02d0-48d8-a697-e4c0c7610704 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:06.793199 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-95fd5cba-02d0-48d8-a697-e4c0c7610704 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:06.800792 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-95fd5cba-02d0-48d8-a697-e4c0c7610704 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.154742 Sep 13 06:42:06.801351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 257/525] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:06 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:07.824110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3ee54bee-ec3d-4172-9a14-92765ee48837 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:07.828186 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3ee54bee-ec3d-4172-9a14-92765ee48837 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:07.831403 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=6 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:07.837653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ee54bee-ec3d-4172-9a14-92765ee48837 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:07.838146 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ee54bee-ec3d-4172-9a14-92765ee48837 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:07.838589 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ee54bee-ec3d-4172-9a14-92765ee48837 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:07.839292 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ee54bee-ec3d-4172-9a14-92765ee48837 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:07.839784 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ee54bee-ec3d-4172-9a14-92765ee48837 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:07.840209 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ee54bee-ec3d-4172-9a14-92765ee48837 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:07.977375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3ee54bee-ec3d-4172-9a14-92765ee48837 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:07.985542 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3ee54bee-ec3d-4172-9a14-92765ee48837 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.166019 Sep 13 06:42:07.986110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 269/526] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:07 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:42:09.007994 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5e07d32b-06a7-4db3-8593-fb36b64fbbf4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:09.008631 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5e07d32b-06a7-4db3-8593-fb36b64fbbf4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:09.011062 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:09.011789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=6 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:09.018085 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e07d32b-06a7-4db3-8593-fb36b64fbbf4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:09.018572 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e07d32b-06a7-4db3-8593-fb36b64fbbf4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:09.019007 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e07d32b-06a7-4db3-8593-fb36b64fbbf4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:09.019727 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e07d32b-06a7-4db3-8593-fb36b64fbbf4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:09.020185 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e07d32b-06a7-4db3-8593-fb36b64fbbf4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:09.020615 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e07d32b-06a7-4db3-8593-fb36b64fbbf4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:09.154368 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5e07d32b-06a7-4db3-8593-fb36b64fbbf4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:09.162418 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5e07d32b-06a7-4db3-8593-fb36b64fbbf4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.158430 Sep 13 06:42:09.162996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 258/527] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:09 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:09.523987 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-4abd4abc-3adf-4957-aa0d-7f068866fdc3 req-23b84d47-f173-47e9-a2a0-cc325001047b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9177caf-8489-4764-a082-2ac3fd7c23c6", "name": "network-vif-plugged", "status": "completed", "tag": "bdb184aa-5e29-4be4-8e1f-80f4a6c82812"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:42:09.535095 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-4abd4abc-3adf-4957-aa0d-7f068866fdc3 req-23b84d47-f173-47e9-a2a0-cc325001047b service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:09.535876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-4abd4abc-3adf-4957-aa0d-7f068866fdc3 req-23b84d47-f173-47e9-a2a0-cc325001047b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:09.536292 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-4abd4abc-3adf-4957-aa0d-7f068866fdc3 req-23b84d47-f173-47e9-a2a0-cc325001047b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:09.548483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-4abd4abc-3adf-4957-aa0d-7f068866fdc3 req-23b84d47-f173-47e9-a2a0-cc325001047b service nova] Creating event network-vif-plugged:bdb184aa-5e29-4be4-8e1f-80f4a6c82812 for instance d9177caf-8489-4764-a082-2ac3fd7c23c6 on hv-cinder-85638 Sep 13 06:42:09.553355 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-4abd4abc-3adf-4957-aa0d-7f068866fdc3 req-23b84d47-f173-47e9-a2a0-cc325001047b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033201 Sep 13 06:42:09.554036 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 270/528] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:42:10.185097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-520bfb62-c73c-46b5-b141-8c925096acbf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:10.185698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-520bfb62-c73c-46b5-b141-8c925096acbf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:10.191998 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-520bfb62-c73c-46b5-b141-8c925096acbf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:10.192477 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-520bfb62-c73c-46b5-b141-8c925096acbf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:10.192908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-520bfb62-c73c-46b5-b141-8c925096acbf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:10.193587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-520bfb62-c73c-46b5-b141-8c925096acbf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:10.194034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-520bfb62-c73c-46b5-b141-8c925096acbf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:10.194452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-520bfb62-c73c-46b5-b141-8c925096acbf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:10.325133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-520bfb62-c73c-46b5-b141-8c925096acbf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:10.332667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-520bfb62-c73c-46b5-b141-8c925096acbf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.151402 Sep 13 06:42:10.333232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 259/529] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:10 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:11.356818 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6cc5d910-3a4c-48fe-a528-3eeba1b0879d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:11.357508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6cc5d910-3a4c-48fe-a528-3eeba1b0879d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:11.363604 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6cc5d910-3a4c-48fe-a528-3eeba1b0879d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:11.364079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6cc5d910-3a4c-48fe-a528-3eeba1b0879d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:11.364506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6cc5d910-3a4c-48fe-a528-3eeba1b0879d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:11.365181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6cc5d910-3a4c-48fe-a528-3eeba1b0879d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:11.365627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6cc5d910-3a4c-48fe-a528-3eeba1b0879d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:11.366044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6cc5d910-3a4c-48fe-a528-3eeba1b0879d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:11.496638 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6cc5d910-3a4c-48fe-a528-3eeba1b0879d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:11.504266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6cc5d910-3a4c-48fe-a528-3eeba1b0879d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.152181 Sep 13 06:42:11.504826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 271/530] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:11 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:12.528614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7cf20cec-d965-4680-8cec-3625273abbd6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:12.529490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7cf20cec-d965-4680-8cec-3625273abbd6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:12.537441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf20cec-d965-4680-8cec-3625273abbd6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:12.537930 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf20cec-d965-4680-8cec-3625273abbd6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:12.538368 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf20cec-d965-4680-8cec-3625273abbd6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:12.539068 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf20cec-d965-4680-8cec-3625273abbd6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:12.539812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf20cec-d965-4680-8cec-3625273abbd6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:12.540238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf20cec-d965-4680-8cec-3625273abbd6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:12.667494 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7cf20cec-d965-4680-8cec-3625273abbd6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:12.675637 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7cf20cec-d965-4680-8cec-3625273abbd6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.152218 Sep 13 06:42:12.676211 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 260/531] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:12 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:12.720058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9caa0d04-dc54-4e78-adb6-eb4730470475 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0448cc48-33e8-41b9-bc6f-2dee2aed58b5", "device": "/dev/sdb"}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:42:12.722885 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9caa0d04-dc54-4e78-adb6-eb4730470475 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:12.729228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9caa0d04-dc54-4e78-adb6-eb4730470475 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:12.729685 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9caa0d04-dc54-4e78-adb6-eb4730470475 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:12.730114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9caa0d04-dc54-4e78-adb6-eb4730470475 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:12.730793 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9caa0d04-dc54-4e78-adb6-eb4730470475 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:12.731238 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9caa0d04-dc54-4e78-adb6-eb4730470475 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:12.731748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9caa0d04-dc54-4e78-adb6-eb4730470475 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:13.023295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9caa0d04-dc54-4e78-adb6-eb4730470475 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "POST /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307168 Sep 13 06:42:13.023935 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 272/532] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:42:12 2022] POST /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:42:13.698047 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e2f75ee9-f148-466b-baa5-ac5ec3b85b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:13.698658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e2f75ee9-f148-466b-baa5-ac5ec3b85b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:13.705160 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e2f75ee9-f148-466b-baa5-ac5ec3b85b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:13.705638 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e2f75ee9-f148-466b-baa5-ac5ec3b85b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:13.706081 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e2f75ee9-f148-466b-baa5-ac5ec3b85b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:13.706764 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e2f75ee9-f148-466b-baa5-ac5ec3b85b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:13.707222 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e2f75ee9-f148-466b-baa5-ac5ec3b85b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:13.707674 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e2f75ee9-f148-466b-baa5-ac5ec3b85b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:13.838084 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e2f75ee9-f148-466b-baa5-ac5ec3b85b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:13.845597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e2f75ee9-f148-466b-baa5-ac5ec3b85b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1366 microversion: 2.1 time: 0.151418 Sep 13 06:42:13.846164 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 261/533] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:13 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:14.867740 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-24a37371-a1b2-46b5-aa80-95a350598b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:14.868904 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-24a37371-a1b2-46b5-aa80-95a350598b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:14.875480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24a37371-a1b2-46b5-aa80-95a350598b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:14.875960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24a37371-a1b2-46b5-aa80-95a350598b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:14.876390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24a37371-a1b2-46b5-aa80-95a350598b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:14.877071 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24a37371-a1b2-46b5-aa80-95a350598b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:14.877547 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24a37371-a1b2-46b5-aa80-95a350598b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:14.877964 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24a37371-a1b2-46b5-aa80-95a350598b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:15.007705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-24a37371-a1b2-46b5-aa80-95a350598b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:15.015793 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-24a37371-a1b2-46b5-aa80-95a350598b65 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1556 microversion: 2.1 time: 0.152354 Sep 13 06:42:15.016355 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 273/534] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:14 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:15.037523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-52d34c4d-3ed5-42c5-ba66-fc2053924f05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:15.038014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-52d34c4d-3ed5-42c5-ba66-fc2053924f05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:15.045123 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-52d34c4d-3ed5-42c5-ba66-fc2053924f05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:15.045633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-52d34c4d-3ed5-42c5-ba66-fc2053924f05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:15.046070 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-52d34c4d-3ed5-42c5-ba66-fc2053924f05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:15.046760 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-52d34c4d-3ed5-42c5-ba66-fc2053924f05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:15.047216 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-52d34c4d-3ed5-42c5-ba66-fc2053924f05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:15.047664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-52d34c4d-3ed5-42c5-ba66-fc2053924f05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:15.122506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-52d34c4d-3ed5-42c5-ba66-fc2053924f05 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088781 Sep 13 06:42:15.123098 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 262/535] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Sep 13 06:42:15 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:42:16.108253 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-cd20127d-d752-4695-8428-a0715ce8afcb req-dd87959a-7108-4bd5-ab8e-3e38fe25cbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9177caf-8489-4764-a082-2ac3fd7c23c6", "tag": "bdb184aa-5e29-4be4-8e1f-80f4a6c82812"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:42:16.118416 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-cd20127d-d752-4695-8428-a0715ce8afcb req-dd87959a-7108-4bd5-ab8e-3e38fe25cbd0 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:16.118833 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-cd20127d-d752-4695-8428-a0715ce8afcb req-dd87959a-7108-4bd5-ab8e-3e38fe25cbd0 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:16.119305 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-cd20127d-d752-4695-8428-a0715ce8afcb req-dd87959a-7108-4bd5-ab8e-3e38fe25cbd0 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:16.130645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-cd20127d-d752-4695-8428-a0715ce8afcb req-dd87959a-7108-4bd5-ab8e-3e38fe25cbd0 service nova] Creating event network-changed:bdb184aa-5e29-4be4-8e1f-80f4a6c82812 for instance d9177caf-8489-4764-a082-2ac3fd7c23c6 on hv-cinder-85638 Sep 13 06:42:16.135733 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-cd20127d-d752-4695-8428-a0715ce8afcb req-dd87959a-7108-4bd5-ab8e-3e38fe25cbd0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038310 Sep 13 06:42:16.136673 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 274/536] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:42:42.907475 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:42.908211 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=56 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:42.913659 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3245aa11-51c3-4a97-bc68-1e428068c7a9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:42.915030 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3245aa11-51c3-4a97-bc68-1e428068c7a9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:42.922539 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3245aa11-51c3-4a97-bc68-1e428068c7a9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:42.923024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3245aa11-51c3-4a97-bc68-1e428068c7a9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:42.923493 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3245aa11-51c3-4a97-bc68-1e428068c7a9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:42.924185 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3245aa11-51c3-4a97-bc68-1e428068c7a9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:42.924639 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3245aa11-51c3-4a97-bc68-1e428068c7a9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:42.925069 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3245aa11-51c3-4a97-bc68-1e428068c7a9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:43.153910 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-3245aa11-51c3-4a97-bc68-1e428068c7a9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lazy-loading 'services' on Instance uuid aa1c0546-fd2a-4a23-8e5b-3648d391b197 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:42:43.269869 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3245aa11-51c3-4a97-bc68-1e428068c7a9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197/os-volume_attachments/0448cc48-33e8-41b9-bc6f-2dee2aed58b5" status: 202 len: 0 microversion: 2.1 time: 0.363604 Sep 13 06:42:43.270660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 263/537] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:42:42 2022] DELETE /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197/os-volume_attachments/0448cc48-33e8-41b9-bc6f-2dee2aed58b5 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:42:45.453390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=19 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:45.454203 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:45.455562 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 06:42:45.455782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Tue Sep 13 06:42:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 (ip 10.222.0.17) !!! Sep 13 06:42:45.460467 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c4580d79-8959-41d0-ba8c-efece9951ca9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:45.461632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c4580d79-8959-41d0-ba8c-efece9951ca9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:45.470482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4580d79-8959-41d0-ba8c-efece9951ca9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:45.470963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4580d79-8959-41d0-ba8c-efece9951ca9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:45.471419 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4580d79-8959-41d0-ba8c-efece9951ca9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:45.472109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4580d79-8959-41d0-ba8c-efece9951ca9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:45.472560 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4580d79-8959-41d0-ba8c-efece9951ca9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:45.472979 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4580d79-8959-41d0-ba8c-efece9951ca9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:45.498431 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c4580d79-8959-41d0-ba8c-efece9951ca9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:42:45.570730 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c4580d79-8959-41d0-ba8c-efece9951ca9 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 204 len: 0 microversion: 2.1 time: 0.117733 Sep 13 06:42:45.571690 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 275/538] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:42:45 2022] DELETE /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:42:45.581369 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-44273dcc-919b-412d-b9a4-4ca929718ccc tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:45.582075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-44273dcc-919b-412d-b9a4-4ca929718ccc tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:45.589300 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44273dcc-919b-412d-b9a4-4ca929718ccc tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:45.589796 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44273dcc-919b-412d-b9a4-4ca929718ccc tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:45.590234 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44273dcc-919b-412d-b9a4-4ca929718ccc tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:45.591110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44273dcc-919b-412d-b9a4-4ca929718ccc tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:45.591934 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44273dcc-919b-412d-b9a4-4ca929718ccc tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:45.592631 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44273dcc-919b-412d-b9a4-4ca929718ccc tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:45.725573 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-44273dcc-919b-412d-b9a4-4ca929718ccc tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:45.733226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-44273dcc-919b-412d-b9a4-4ca929718ccc tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1513 microversion: 2.1 time: 0.156575 Sep 13 06:42:45.733793 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 264/539] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:45 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:46.755425 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d7d3ad99-52d8-4d58-b32d-143e44b47176 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:46.756147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d7d3ad99-52d8-4d58-b32d-143e44b47176 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:46.762384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d7d3ad99-52d8-4d58-b32d-143e44b47176 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:46.762855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d7d3ad99-52d8-4d58-b32d-143e44b47176 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:46.763278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d7d3ad99-52d8-4d58-b32d-143e44b47176 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:46.763982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d7d3ad99-52d8-4d58-b32d-143e44b47176 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:46.764428 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d7d3ad99-52d8-4d58-b32d-143e44b47176 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:46.764843 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d7d3ad99-52d8-4d58-b32d-143e44b47176 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:46.947280 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d7d3ad99-52d8-4d58-b32d-143e44b47176 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:46.954890 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d7d3ad99-52d8-4d58-b32d-143e44b47176 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1513 microversion: 2.1 time: 0.203652 Sep 13 06:42:46.955471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 276/540] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:46 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:47.978485 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5f3519aa-c4e6-407e-b560-65deffe56377 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:47.979347 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5f3519aa-c4e6-407e-b560-65deffe56377 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:47.986059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f3519aa-c4e6-407e-b560-65deffe56377 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:47.986549 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f3519aa-c4e6-407e-b560-65deffe56377 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:47.986986 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f3519aa-c4e6-407e-b560-65deffe56377 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:47.987838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f3519aa-c4e6-407e-b560-65deffe56377 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:47.988299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f3519aa-c4e6-407e-b560-65deffe56377 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:47.988910 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f3519aa-c4e6-407e-b560-65deffe56377 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:48.194075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5f3519aa-c4e6-407e-b560-65deffe56377 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:42:48.202511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5f3519aa-c4e6-407e-b560-65deffe56377 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 200 len: 1513 microversion: 2.1 time: 0.228420 Sep 13 06:42:48.203095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 265/541] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:47 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:42:48.349624 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-ccd94a66-2ba0-414a-8706-f3f7ba1cffec req-db11863c-8bb9-4adf-9fef-1b3745edc6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa1c0546-fd2a-4a23-8e5b-3648d391b197", "name": "network-vif-deleted", "tag": "b8415a51-f633-47b3-9f8d-1ff75aacfa40"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:42:48.360106 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-ccd94a66-2ba0-414a-8706-f3f7ba1cffec req-db11863c-8bb9-4adf-9fef-1b3745edc6ab service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:48.360577 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-ccd94a66-2ba0-414a-8706-f3f7ba1cffec req-db11863c-8bb9-4adf-9fef-1b3745edc6ab service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:48.361198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-ccd94a66-2ba0-414a-8706-f3f7ba1cffec req-db11863c-8bb9-4adf-9fef-1b3745edc6ab service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:48.372145 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-ccd94a66-2ba0-414a-8706-f3f7ba1cffec req-db11863c-8bb9-4adf-9fef-1b3745edc6ab service nova] Creating event network-vif-deleted:b8415a51-f633-47b3-9f8d-1ff75aacfa40 for instance aa1c0546-fd2a-4a23-8e5b-3648d391b197 on hv-cinder-85638 Sep 13 06:42:48.376814 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-ccd94a66-2ba0-414a-8706-f3f7ba1cffec req-db11863c-8bb9-4adf-9fef-1b3745edc6ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030873 Sep 13 06:42:48.377498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 277/542] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:42:49.225374 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:42:49.226488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: aa1c0546-fd2a-4a23-8e5b-3648d391b197] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:42:49.232791 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:49.233277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:49.233697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:49.234375 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:42:49.234827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:42:49.235250 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:42:49.248905 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] HTTP exception thrown: Instance aa1c0546-fd2a-4a23-8e5b-3648d391b197 could not be found. Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Request method failure captured: Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 HTTP/1.1 Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICYYirS_37QDWRecuCHJiVG4QHzo8HqOoyMtYjFZO5X5PIAENXmR92O-6G81KRXYCbiU_DY8Bxwjbi9dWquDoeTPfYFffYwHa23tkGekTOtmLNr5E1YxLw_FfnvdLBH2n8OTLsYPm8-CUMaHj6hlpm1-QEXSNUcl0fUDxCmyo3eFsHI Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 5140d3b3124d4fbbb3859a597710cf48 Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-VolumesSnapshotTestJSON-137301379 Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:42:49.250519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5140d3b3124d4fbbb3859a597710cf48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5140d3b3124d4fbbb3859a597710cf48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5140d3b3124d4fbbb3859a597710cf48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5140d3b3124d4fbbb3859a597710cf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-VolumesSnapshotTestJSON-137301379 Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 5140d3b3124d4fbbb3859a597710cf48 Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-137301379 Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-VolumesSnapshotTestJSON-137301379-project Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 4250279832584ec4a77ce899e850b848 Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-VolumesSnapshotTestJSON-137301379-project Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance aa1c0546-fd2a-4a23-8e5b-3648d391b197 could not be found. Sep 13 06:42:49.252153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'aa1c0546-fd2a-4a23-8e5b-3648d391b197'} Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa1c0546-fd2a-4a23-8e5b-3648d391b197 could not be found. Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:42:49.253311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa1c0546-fd2a-4a23-8e5b-3648d391b197 could not be found. Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa1c0546-fd2a-4a23-8e5b-3648d391b197 could not be found. Sep 13 06:42:49.254802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:42:49.256227 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Returning 404 to user: Instance aa1c0546-fd2a-4a23-8e5b-3648d391b197 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:42:49.256227 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a14cf148-6874-4dc0-8931-a6e29ebf9548 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197" status: 404 len: 111 microversion: 2.1 time: 0.030373 Sep 13 06:42:49.256227 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 266/543] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:42:49 2022] GET /compute/v2.1/servers/aa1c0546-fd2a-4a23-8e5b-3648d391b197 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:43:01.137656 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:01.138382 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:01.142738 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1498077839", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "networks": [{"uuid": "ef28f84e-f778-4ee4-8f82-1c442023ec33"}]}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:43:01.198226 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.network.neutron [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] validate_networks() for [('ef28f84e-f778-4ee4-8f82-1c442023ec33', None, None, None, None, None)] {{(pid=132399) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:43:01.584700 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Flavor limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:43:01.585708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Image limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:43:01.586383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Flavor pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:43:01.586577 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Image pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:43:01.587012 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:43:01.595823 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:01.596304 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:01.596738 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:01.597466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:01.597920 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:01.598343 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:01.614657 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Getting quotas for project 5140d3b3124d4fbbb3859a597710cf48. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:43:01.619062 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Getting quotas for user 4250279832584ec4a77ce899e850b848 and project 5140d3b3124d4fbbb3859a597710cf48. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:43:01.629711 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Going to run 1 instances... {{(pid=132399) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:43:01.632699 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:43:01.677668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2e8adbc6-0c24-42f2-b680-1a31187a78de tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541676 Sep 13 06:43:01.678320 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 278/544] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:43:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:43:01.689703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c6aa7c72-7b7e-4354-8f5d-1b2944543816 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:01.690520 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c6aa7c72-7b7e-4354-8f5d-1b2944543816 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:01.693132 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=8 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:01.696463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:01.749630 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c6aa7c72-7b7e-4354-8f5d-1b2944543816 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:01.760765 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c6aa7c72-7b7e-4354-8f5d-1b2944543816 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1219 microversion: 2.1 time: 0.074864 Sep 13 06:43:01.761389 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 267/545] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:01 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:02.783498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-802a405f-a1fb-44c5-8baa-8eb378a16be8 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:02.784030 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-802a405f-a1fb-44c5-8baa-8eb378a16be8 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:02.790952 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-802a405f-a1fb-44c5-8baa-8eb378a16be8 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:02.791471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-802a405f-a1fb-44c5-8baa-8eb378a16be8 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:02.791906 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-802a405f-a1fb-44c5-8baa-8eb378a16be8 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:02.792588 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-802a405f-a1fb-44c5-8baa-8eb378a16be8 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:02.793043 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-802a405f-a1fb-44c5-8baa-8eb378a16be8 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:02.793466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-802a405f-a1fb-44c5-8baa-8eb378a16be8 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:02.855499 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-802a405f-a1fb-44c5-8baa-8eb378a16be8 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:02.862965 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-802a405f-a1fb-44c5-8baa-8eb378a16be8 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1271 microversion: 2.1 time: 0.083910 Sep 13 06:43:02.863555 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 279/546] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:02 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:03.885228 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-37986196-c181-4177-a07a-87ba46ba0c19 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:03.885785 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-37986196-c181-4177-a07a-87ba46ba0c19 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:03.892946 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-37986196-c181-4177-a07a-87ba46ba0c19 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:03.893510 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-37986196-c181-4177-a07a-87ba46ba0c19 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:03.894029 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-37986196-c181-4177-a07a-87ba46ba0c19 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:03.894760 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-37986196-c181-4177-a07a-87ba46ba0c19 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:03.895225 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-37986196-c181-4177-a07a-87ba46ba0c19 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:03.895701 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-37986196-c181-4177-a07a-87ba46ba0c19 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:04.114557 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-37986196-c181-4177-a07a-87ba46ba0c19 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:04.123010 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-37986196-c181-4177-a07a-87ba46ba0c19 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1319 microversion: 2.1 time: 0.242163 Sep 13 06:43:04.123689 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 268/547] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:03 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:04.868343 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-bc026dc2-0c1b-4622-b75c-056cff34d5be req-ae173687-6e66-446c-8a7d-0bfcb058f1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2b8671-ddea-4699-94a6-a8dfb479ed73", "tag": "175d99ec-de43-4157-936c-69701073bdd1"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:43:04.877400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-bc026dc2-0c1b-4622-b75c-056cff34d5be req-ae173687-6e66-446c-8a7d-0bfcb058f1c1 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:04.877873 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-bc026dc2-0c1b-4622-b75c-056cff34d5be req-ae173687-6e66-446c-8a7d-0bfcb058f1c1 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:04.878291 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-bc026dc2-0c1b-4622-b75c-056cff34d5be req-ae173687-6e66-446c-8a7d-0bfcb058f1c1 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:04.889534 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-bc026dc2-0c1b-4622-b75c-056cff34d5be req-ae173687-6e66-446c-8a7d-0bfcb058f1c1 service nova] Creating event network-changed:175d99ec-de43-4157-936c-69701073bdd1 for instance 7f2b8671-ddea-4699-94a6-a8dfb479ed73 on hv-cinder-85638 Sep 13 06:43:04.894667 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-bc026dc2-0c1b-4622-b75c-056cff34d5be req-ae173687-6e66-446c-8a7d-0bfcb058f1c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093471 Sep 13 06:43:04.895456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 280/548] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:43:05.145584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-60b80131-f337-4212-91e0-c65aa823bf13 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:05.146200 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-60b80131-f337-4212-91e0-c65aa823bf13 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:05.153160 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60b80131-f337-4212-91e0-c65aa823bf13 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:05.153666 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60b80131-f337-4212-91e0-c65aa823bf13 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:05.154088 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60b80131-f337-4212-91e0-c65aa823bf13 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:05.154785 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60b80131-f337-4212-91e0-c65aa823bf13 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:05.155247 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60b80131-f337-4212-91e0-c65aa823bf13 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:05.155702 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60b80131-f337-4212-91e0-c65aa823bf13 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:05.324751 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-60b80131-f337-4212-91e0-c65aa823bf13 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:05.332556 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-60b80131-f337-4212-91e0-c65aa823bf13 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1319 microversion: 2.1 time: 0.190827 Sep 13 06:43:05.333124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 269/549] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:05 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:06.357357 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1e8f4f0e-f7d6-4fce-9e4a-0c4af6ac5088 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:06.358310 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1e8f4f0e-f7d6-4fce-9e4a-0c4af6ac5088 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:06.364443 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1e8f4f0e-f7d6-4fce-9e4a-0c4af6ac5088 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:06.364926 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1e8f4f0e-f7d6-4fce-9e4a-0c4af6ac5088 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:06.365357 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1e8f4f0e-f7d6-4fce-9e4a-0c4af6ac5088 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:06.366047 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1e8f4f0e-f7d6-4fce-9e4a-0c4af6ac5088 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:06.366503 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1e8f4f0e-f7d6-4fce-9e4a-0c4af6ac5088 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:06.366991 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1e8f4f0e-f7d6-4fce-9e4a-0c4af6ac5088 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:06.500477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1e8f4f0e-f7d6-4fce-9e4a-0c4af6ac5088 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:06.508494 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1e8f4f0e-f7d6-4fce-9e4a-0c4af6ac5088 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1319 microversion: 2.1 time: 0.155879 Sep 13 06:43:06.509060 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 281/550] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:06 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:07.530648 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-447dc3ea-5eb6-47ab-8fe8-31999d0f7c57 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:07.531260 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-447dc3ea-5eb6-47ab-8fe8-31999d0f7c57 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:07.537630 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-447dc3ea-5eb6-47ab-8fe8-31999d0f7c57 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:07.538616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-447dc3ea-5eb6-47ab-8fe8-31999d0f7c57 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:07.539305 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-447dc3ea-5eb6-47ab-8fe8-31999d0f7c57 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:07.540034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-447dc3ea-5eb6-47ab-8fe8-31999d0f7c57 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:07.540492 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-447dc3ea-5eb6-47ab-8fe8-31999d0f7c57 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:07.540913 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-447dc3ea-5eb6-47ab-8fe8-31999d0f7c57 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:07.673011 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-447dc3ea-5eb6-47ab-8fe8-31999d0f7c57 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:07.680693 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-447dc3ea-5eb6-47ab-8fe8-31999d0f7c57 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1319 microversion: 2.1 time: 0.153922 Sep 13 06:43:07.681267 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 270/551] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:07 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:08.702237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0105097c-7d6e-4ecf-9467-63b4314ff9a0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:08.702831 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0105097c-7d6e-4ecf-9467-63b4314ff9a0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:08.709142 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0105097c-7d6e-4ecf-9467-63b4314ff9a0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:08.709620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0105097c-7d6e-4ecf-9467-63b4314ff9a0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:08.710023 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0105097c-7d6e-4ecf-9467-63b4314ff9a0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:08.710732 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0105097c-7d6e-4ecf-9467-63b4314ff9a0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:08.711174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0105097c-7d6e-4ecf-9467-63b4314ff9a0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:08.711609 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0105097c-7d6e-4ecf-9467-63b4314ff9a0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:08.839900 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0105097c-7d6e-4ecf-9467-63b4314ff9a0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:08.847585 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0105097c-7d6e-4ecf-9467-63b4314ff9a0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1319 microversion: 2.1 time: 0.149385 Sep 13 06:43:08.848156 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 282/552] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:08 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:09.870057 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8bc99a4d-2c40-48e2-b02d-750273545729 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:09.870667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8bc99a4d-2c40-48e2-b02d-750273545729 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:09.877075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8bc99a4d-2c40-48e2-b02d-750273545729 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:09.877561 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8bc99a4d-2c40-48e2-b02d-750273545729 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:09.877994 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8bc99a4d-2c40-48e2-b02d-750273545729 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:09.878682 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8bc99a4d-2c40-48e2-b02d-750273545729 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:09.879138 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8bc99a4d-2c40-48e2-b02d-750273545729 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:09.879589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8bc99a4d-2c40-48e2-b02d-750273545729 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:10.007008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8bc99a4d-2c40-48e2-b02d-750273545729 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:10.014640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8bc99a4d-2c40-48e2-b02d-750273545729 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1319 microversion: 2.1 time: 0.148495 Sep 13 06:43:10.015201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 271/553] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:09 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:11.037253 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c8559b9f-fc7d-4a49-9616-8cfe471f9522 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:11.038365 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c8559b9f-fc7d-4a49-9616-8cfe471f9522 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:11.044905 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c8559b9f-fc7d-4a49-9616-8cfe471f9522 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:11.045384 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c8559b9f-fc7d-4a49-9616-8cfe471f9522 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:11.045810 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c8559b9f-fc7d-4a49-9616-8cfe471f9522 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:11.046486 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c8559b9f-fc7d-4a49-9616-8cfe471f9522 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:11.046934 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c8559b9f-fc7d-4a49-9616-8cfe471f9522 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:11.047350 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c8559b9f-fc7d-4a49-9616-8cfe471f9522 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:11.180238 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c8559b9f-fc7d-4a49-9616-8cfe471f9522 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:11.187695 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c8559b9f-fc7d-4a49-9616-8cfe471f9522 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1319 microversion: 2.1 time: 0.154244 Sep 13 06:43:11.188251 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 283/554] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:11 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:11.921327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:11.979589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-4d38147b-bee2-4f57-8365-574778989ec9 req-cbed5792-15da-4aff-96f1-2dbf9e4851a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2b8671-ddea-4699-94a6-a8dfb479ed73", "name": "network-vif-plugged", "status": "completed", "tag": "175d99ec-de43-4157-936c-69701073bdd1"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:43:11.989205 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-4d38147b-bee2-4f57-8365-574778989ec9 req-cbed5792-15da-4aff-96f1-2dbf9e4851a5 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:11.989716 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-4d38147b-bee2-4f57-8365-574778989ec9 req-cbed5792-15da-4aff-96f1-2dbf9e4851a5 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:11.990167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-4d38147b-bee2-4f57-8365-574778989ec9 req-cbed5792-15da-4aff-96f1-2dbf9e4851a5 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:12.001751 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-4d38147b-bee2-4f57-8365-574778989ec9 req-cbed5792-15da-4aff-96f1-2dbf9e4851a5 service nova] Creating event network-vif-plugged:175d99ec-de43-4157-936c-69701073bdd1 for instance 7f2b8671-ddea-4699-94a6-a8dfb479ed73 on hv-cinder-85638 Sep 13 06:43:12.006587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-4d38147b-bee2-4f57-8365-574778989ec9 req-cbed5792-15da-4aff-96f1-2dbf9e4851a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090254 Sep 13 06:43:12.007161 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 272/555] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:43:12.211655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e2268808-b1f9-4d6e-865f-d85bc7adef9c tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:12.212294 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e2268808-b1f9-4d6e-865f-d85bc7adef9c tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:12.214270 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:12.215063 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=6 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:12.222179 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e2268808-b1f9-4d6e-865f-d85bc7adef9c tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:12.222872 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e2268808-b1f9-4d6e-865f-d85bc7adef9c tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:12.223511 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e2268808-b1f9-4d6e-865f-d85bc7adef9c tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:12.224216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e2268808-b1f9-4d6e-865f-d85bc7adef9c tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:12.224678 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e2268808-b1f9-4d6e-865f-d85bc7adef9c tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:12.225624 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e2268808-b1f9-4d6e-865f-d85bc7adef9c tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:12.356163 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e2268808-b1f9-4d6e-865f-d85bc7adef9c tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:12.364096 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e2268808-b1f9-4d6e-865f-d85bc7adef9c tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1319 microversion: 2.1 time: 0.157149 Sep 13 06:43:12.364607 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 284/556] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:12 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:13.387983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a0a918d6-c73c-42f4-962f-b01ed96aab68 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:13.388686 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a0a918d6-c73c-42f4-962f-b01ed96aab68 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:13.394745 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0a918d6-c73c-42f4-962f-b01ed96aab68 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:13.395226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0a918d6-c73c-42f4-962f-b01ed96aab68 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:13.395687 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0a918d6-c73c-42f4-962f-b01ed96aab68 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:13.396376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0a918d6-c73c-42f4-962f-b01ed96aab68 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:13.397417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0a918d6-c73c-42f4-962f-b01ed96aab68 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:13.397853 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0a918d6-c73c-42f4-962f-b01ed96aab68 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:13.529651 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a0a918d6-c73c-42f4-962f-b01ed96aab68 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:13.537149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a0a918d6-c73c-42f4-962f-b01ed96aab68 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1319 microversion: 2.1 time: 0.153862 Sep 13 06:43:13.537761 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 273/557] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:13 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:14.559691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-91274353-5dfa-4cfb-a00c-58d06010230d tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:14.560296 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-91274353-5dfa-4cfb-a00c-58d06010230d tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:14.566808 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91274353-5dfa-4cfb-a00c-58d06010230d tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:14.567285 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91274353-5dfa-4cfb-a00c-58d06010230d tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:14.567744 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91274353-5dfa-4cfb-a00c-58d06010230d tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:14.568424 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91274353-5dfa-4cfb-a00c-58d06010230d tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:14.568871 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91274353-5dfa-4cfb-a00c-58d06010230d tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:14.569288 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-91274353-5dfa-4cfb-a00c-58d06010230d tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:14.696698 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-91274353-5dfa-4cfb-a00c-58d06010230d tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:14.704253 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-91274353-5dfa-4cfb-a00c-58d06010230d tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1319 microversion: 2.1 time: 0.148410 Sep 13 06:43:14.704815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 285/558] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:14 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:15.727661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-72141770-0428-47b9-8e8b-065ffcd42161 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:15.728200 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-72141770-0428-47b9-8e8b-065ffcd42161 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:15.734564 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-72141770-0428-47b9-8e8b-065ffcd42161 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:15.735042 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-72141770-0428-47b9-8e8b-065ffcd42161 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:15.735512 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-72141770-0428-47b9-8e8b-065ffcd42161 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:15.736195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-72141770-0428-47b9-8e8b-065ffcd42161 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:15.736646 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-72141770-0428-47b9-8e8b-065ffcd42161 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:15.737063 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-72141770-0428-47b9-8e8b-065ffcd42161 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:15.864036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-72141770-0428-47b9-8e8b-065ffcd42161 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:15.871738 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-72141770-0428-47b9-8e8b-065ffcd42161 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1507 microversion: 2.1 time: 0.148360 Sep 13 06:43:15.872287 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 274/559] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:15 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:15.893516 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-be6888f5-1537-45dd-b526-01a90df60606 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e3f9b8a-37f9-46c2-a031-e28802f15696", "device": "/dev/sdb"}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:43:15.895971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-be6888f5-1537-45dd-b526-01a90df60606 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:15.902752 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be6888f5-1537-45dd-b526-01a90df60606 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:15.903233 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be6888f5-1537-45dd-b526-01a90df60606 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:15.903704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be6888f5-1537-45dd-b526-01a90df60606 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:15.904391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be6888f5-1537-45dd-b526-01a90df60606 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:15.904876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be6888f5-1537-45dd-b526-01a90df60606 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:15.905302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be6888f5-1537-45dd-b526-01a90df60606 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:16.178671 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-be6888f5-1537-45dd-b526-01a90df60606 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "POST /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288811 Sep 13 06:43:16.179269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 286/560] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:43:15 2022] POST /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:43:21.944315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-24caee51-4d16-4e84-92ec-ba98cf642aab tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1646bb9-d323-44f2-956c-9e2cd8a0c06d"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:43:21.946701 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-24caee51-4d16-4e84-92ec-ba98cf642aab tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:21.952687 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24caee51-4d16-4e84-92ec-ba98cf642aab tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:21.953169 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24caee51-4d16-4e84-92ec-ba98cf642aab tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:21.953601 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24caee51-4d16-4e84-92ec-ba98cf642aab tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:21.954289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24caee51-4d16-4e84-92ec-ba98cf642aab tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:21.954744 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24caee51-4d16-4e84-92ec-ba98cf642aab tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:21.955166 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24caee51-4d16-4e84-92ec-ba98cf642aab tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:22.371118 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-24caee51-4d16-4e84-92ec-ba98cf642aab tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525887 Sep 13 06:43:22.371747 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 275/561] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:43:21 2022] POST /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:43:33.069315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:33.070166 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:33.074618 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d3f3bd2d-153e-4269-b956-baeaf22f039c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:43:33.077194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d3f3bd2d-153e-4269-b956-baeaf22f039c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:33.085353 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d3f3bd2d-153e-4269-b956-baeaf22f039c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:33.085843 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d3f3bd2d-153e-4269-b956-baeaf22f039c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:33.086276 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d3f3bd2d-153e-4269-b956-baeaf22f039c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:33.087599 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d3f3bd2d-153e-4269-b956-baeaf22f039c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:33.088058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d3f3bd2d-153e-4269-b956-baeaf22f039c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:33.088484 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d3f3bd2d-153e-4269-b956-baeaf22f039c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:33.113125 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.objects.instance [None req-d3f3bd2d-153e-4269-b956-baeaf22f039c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lazy-loading 'flavor' on Instance uuid d2001137-a4ff-4946-bc5e-56f38c00f36e {{(pid=132399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:43:33.278073 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d3f3bd2d-153e-4269-b956-baeaf22f039c tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/action" status: 200 len: 32 microversion: 2.1 time: 0.210122 Sep 13 06:43:33.278667 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 287/562] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:43:33 2022] POST /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 06:43:33.285857 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=20 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:33.286720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:33.292077 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f26f23f1-5d52-4aa8-a139-10b8ec9d4717 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:33.292776 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f26f23f1-5d52-4aa8-a139-10b8ec9d4717 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:33.299977 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f26f23f1-5d52-4aa8-a139-10b8ec9d4717 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:33.300467 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f26f23f1-5d52-4aa8-a139-10b8ec9d4717 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:33.300902 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f26f23f1-5d52-4aa8-a139-10b8ec9d4717 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:33.301591 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f26f23f1-5d52-4aa8-a139-10b8ec9d4717 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:33.302047 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f26f23f1-5d52-4aa8-a139-10b8ec9d4717 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:33.302506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f26f23f1-5d52-4aa8-a139-10b8ec9d4717 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:33.434943 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f26f23f1-5d52-4aa8-a139-10b8ec9d4717 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:33.443753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f26f23f1-5d52-4aa8-a139-10b8ec9d4717 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.158850 Sep 13 06:43:33.444296 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 276/563] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:33 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:34.469178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-20d22ccd-dc2b-438d-9a8c-b6bb584b57cf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:34.469884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-20d22ccd-dc2b-438d-9a8c-b6bb584b57cf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:34.477631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20d22ccd-dc2b-438d-9a8c-b6bb584b57cf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:34.478119 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20d22ccd-dc2b-438d-9a8c-b6bb584b57cf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:34.478553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20d22ccd-dc2b-438d-9a8c-b6bb584b57cf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:34.479241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20d22ccd-dc2b-438d-9a8c-b6bb584b57cf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:34.479723 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20d22ccd-dc2b-438d-9a8c-b6bb584b57cf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:34.480147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-20d22ccd-dc2b-438d-9a8c-b6bb584b57cf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:34.612744 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-20d22ccd-dc2b-438d-9a8c-b6bb584b57cf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:34.620902 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-20d22ccd-dc2b-438d-9a8c-b6bb584b57cf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.156058 Sep 13 06:43:34.621458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 288/564] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:34 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:35.643851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f7dac2bf-2db2-43f6-bd38-da9128722bfd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:35.644454 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f7dac2bf-2db2-43f6-bd38-da9128722bfd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:35.650690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f7dac2bf-2db2-43f6-bd38-da9128722bfd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:35.651169 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f7dac2bf-2db2-43f6-bd38-da9128722bfd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:35.651636 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f7dac2bf-2db2-43f6-bd38-da9128722bfd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:35.652321 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f7dac2bf-2db2-43f6-bd38-da9128722bfd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:35.652773 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f7dac2bf-2db2-43f6-bd38-da9128722bfd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:35.653197 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f7dac2bf-2db2-43f6-bd38-da9128722bfd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:35.780080 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f7dac2bf-2db2-43f6-bd38-da9128722bfd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:35.789148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f7dac2bf-2db2-43f6-bd38-da9128722bfd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.148864 Sep 13 06:43:35.789710 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 277/565] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:35 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:36.812661 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7460b93a-c57d-4f30-a700-867a2acef72b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:36.813267 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7460b93a-c57d-4f30-a700-867a2acef72b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:36.819658 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7460b93a-c57d-4f30-a700-867a2acef72b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:36.820142 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7460b93a-c57d-4f30-a700-867a2acef72b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:36.820570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7460b93a-c57d-4f30-a700-867a2acef72b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:36.821252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7460b93a-c57d-4f30-a700-867a2acef72b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:36.821700 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7460b93a-c57d-4f30-a700-867a2acef72b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:36.822120 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7460b93a-c57d-4f30-a700-867a2acef72b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:36.957064 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7460b93a-c57d-4f30-a700-867a2acef72b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:36.965717 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7460b93a-c57d-4f30-a700-867a2acef72b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.156956 Sep 13 06:43:36.966282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 289/566] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:36 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:37.250993 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-273ebf38-f8e2-419c-a0eb-ac9c0fbc6454 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:37.251516 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-273ebf38-f8e2-419c-a0eb-ac9c0fbc6454 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:37.257798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-273ebf38-f8e2-419c-a0eb-ac9c0fbc6454 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:37.258274 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-273ebf38-f8e2-419c-a0eb-ac9c0fbc6454 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:37.258743 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-273ebf38-f8e2-419c-a0eb-ac9c0fbc6454 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:37.259455 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-273ebf38-f8e2-419c-a0eb-ac9c0fbc6454 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:37.259906 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-273ebf38-f8e2-419c-a0eb-ac9c0fbc6454 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:37.260325 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-273ebf38-f8e2-419c-a0eb-ac9c0fbc6454 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:37.340017 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-273ebf38-f8e2-419c-a0eb-ac9c0fbc6454 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lazy-loading 'services' on Instance uuid 4e145800-524d-4430-b95f-aff5b2719b66 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:43:37.411875 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-273ebf38-f8e2-419c-a0eb-ac9c0fbc6454 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/os-volume_attachments/b1349415-18e6-4537-b566-4a61c5f3b5a6" status: 202 len: 0 microversion: 2.1 time: 0.261075 Sep 13 06:43:37.412452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 278/567] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:43:37 2022] DELETE /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/os-volume_attachments/b1349415-18e6-4537-b566-4a61c5f3b5a6 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:43:37.988705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-966ceda2-e4c2-40fb-9c8a-4e6a3226e59d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:37.989307 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-966ceda2-e4c2-40fb-9c8a-4e6a3226e59d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:37.996211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-966ceda2-e4c2-40fb-9c8a-4e6a3226e59d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:37.996689 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-966ceda2-e4c2-40fb-9c8a-4e6a3226e59d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:37.997123 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-966ceda2-e4c2-40fb-9c8a-4e6a3226e59d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:37.997829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-966ceda2-e4c2-40fb-9c8a-4e6a3226e59d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:37.998280 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-966ceda2-e4c2-40fb-9c8a-4e6a3226e59d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:37.998699 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-966ceda2-e4c2-40fb-9c8a-4e6a3226e59d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:38.127970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-966ceda2-e4c2-40fb-9c8a-4e6a3226e59d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:38.135954 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-966ceda2-e4c2-40fb-9c8a-4e6a3226e59d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.151160 Sep 13 06:43:38.136521 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 290/568] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:37 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:39.158928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-12c147ec-1eab-4e4f-ac4d-9e345171e011 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:39.159668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-12c147ec-1eab-4e4f-ac4d-9e345171e011 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:39.166040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-12c147ec-1eab-4e4f-ac4d-9e345171e011 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:39.166473 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-12c147ec-1eab-4e4f-ac4d-9e345171e011 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:39.166907 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-12c147ec-1eab-4e4f-ac4d-9e345171e011 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:39.167655 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-12c147ec-1eab-4e4f-ac4d-9e345171e011 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:39.168110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-12c147ec-1eab-4e4f-ac4d-9e345171e011 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:39.168534 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-12c147ec-1eab-4e4f-ac4d-9e345171e011 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:39.298934 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-12c147ec-1eab-4e4f-ac4d-9e345171e011 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:39.308121 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-12c147ec-1eab-4e4f-ac4d-9e345171e011 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.153858 Sep 13 06:43:39.308681 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 279/569] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:39 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:39.605791 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b6d891e3-7f21-4eab-b76a-1988e1e588ea tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:43:39.612305 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b6d891e3-7f21-4eab-b76a-1988e1e588ea tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:39.612736 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b6d891e3-7f21-4eab-b76a-1988e1e588ea tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:39.613167 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b6d891e3-7f21-4eab-b76a-1988e1e588ea tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:39.635659 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b6d891e3-7f21-4eab-b76a-1988e1e588ea tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Going to try to stop instance {{(pid=132399) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 06:43:39.679883 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b6d891e3-7f21-4eab-b76a-1988e1e588ea tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/action" status: 202 len: 0 microversion: 2.1 time: 0.077820 Sep 13 06:43:39.680416 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 291/570] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:43:39 2022] POST /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:43:39.688990 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7ec02ca1-7450-4369-882e-10f605bfc364 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:39.689596 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7ec02ca1-7450-4369-882e-10f605bfc364 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:39.696094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7ec02ca1-7450-4369-882e-10f605bfc364 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:39.696587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7ec02ca1-7450-4369-882e-10f605bfc364 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:39.697027 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7ec02ca1-7450-4369-882e-10f605bfc364 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:39.697750 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7ec02ca1-7450-4369-882e-10f605bfc364 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:39.698636 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7ec02ca1-7450-4369-882e-10f605bfc364 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:39.698636 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7ec02ca1-7450-4369-882e-10f605bfc364 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:39.868043 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7ec02ca1-7450-4369-882e-10f605bfc364 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:39.875839 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7ec02ca1-7450-4369-882e-10f605bfc364 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.190670 Sep 13 06:43:39.876494 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 280/571] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:39 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:40.332293 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-552222e2-1d35-4cb4-a314-01b3dec90991 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:40.332985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-552222e2-1d35-4cb4-a314-01b3dec90991 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:40.339003 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-552222e2-1d35-4cb4-a314-01b3dec90991 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:40.339526 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-552222e2-1d35-4cb4-a314-01b3dec90991 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:40.339957 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-552222e2-1d35-4cb4-a314-01b3dec90991 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:40.340648 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-552222e2-1d35-4cb4-a314-01b3dec90991 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:40.341101 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-552222e2-1d35-4cb4-a314-01b3dec90991 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:40.341512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-552222e2-1d35-4cb4-a314-01b3dec90991 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:40.470342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-552222e2-1d35-4cb4-a314-01b3dec90991 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:40.478929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-552222e2-1d35-4cb4-a314-01b3dec90991 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.150839 Sep 13 06:43:40.479524 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 292/572] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:40 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:40.898813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-16bb0a59-36bc-4e8b-ac92-0afe4fbebb74 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:40.899328 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-16bb0a59-36bc-4e8b-ac92-0afe4fbebb74 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:40.905832 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-16bb0a59-36bc-4e8b-ac92-0afe4fbebb74 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:40.906315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-16bb0a59-36bc-4e8b-ac92-0afe4fbebb74 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:40.906753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-16bb0a59-36bc-4e8b-ac92-0afe4fbebb74 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:40.907496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-16bb0a59-36bc-4e8b-ac92-0afe4fbebb74 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:40.907951 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-16bb0a59-36bc-4e8b-ac92-0afe4fbebb74 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:40.908373 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-16bb0a59-36bc-4e8b-ac92-0afe4fbebb74 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:41.049518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-16bb0a59-36bc-4e8b-ac92-0afe4fbebb74 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:41.058091 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-16bb0a59-36bc-4e8b-ac92-0afe4fbebb74 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.163227 Sep 13 06:43:41.058657 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 281/573] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:40 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:41.502505 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-19dfe9df-9970-4d71-bd59-33e38e553b95 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:41.503102 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-19dfe9df-9970-4d71-bd59-33e38e553b95 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:41.509362 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-19dfe9df-9970-4d71-bd59-33e38e553b95 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:41.509833 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-19dfe9df-9970-4d71-bd59-33e38e553b95 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:41.510255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-19dfe9df-9970-4d71-bd59-33e38e553b95 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:41.510928 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-19dfe9df-9970-4d71-bd59-33e38e553b95 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:41.511394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-19dfe9df-9970-4d71-bd59-33e38e553b95 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:41.511807 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-19dfe9df-9970-4d71-bd59-33e38e553b95 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:41.637588 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-19dfe9df-9970-4d71-bd59-33e38e553b95 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:41.646313 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-19dfe9df-9970-4d71-bd59-33e38e553b95 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.147553 Sep 13 06:43:41.647436 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 293/574] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:41 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:41.752299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e98199e0-fdc6-4ffd-96d2-d948484b4366 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:41.752794 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e98199e0-fdc6-4ffd-96d2-d948484b4366 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:41.759144 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e98199e0-fdc6-4ffd-96d2-d948484b4366 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:41.759665 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e98199e0-fdc6-4ffd-96d2-d948484b4366 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:41.760102 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e98199e0-fdc6-4ffd-96d2-d948484b4366 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:41.760813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e98199e0-fdc6-4ffd-96d2-d948484b4366 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:41.761298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e98199e0-fdc6-4ffd-96d2-d948484b4366 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:41.761772 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e98199e0-fdc6-4ffd-96d2-d948484b4366 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:41.839988 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-e98199e0-fdc6-4ffd-96d2-d948484b4366 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lazy-loading 'services' on Instance uuid 7f2b8671-ddea-4699-94a6-a8dfb479ed73 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:43:41.912880 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e98199e0-fdc6-4ffd-96d2-d948484b4366 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73/os-volume_attachments/0e3f9b8a-37f9-46c2-a031-e28802f15696" status: 202 len: 0 microversion: 2.1 time: 0.164296 Sep 13 06:43:41.914135 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 282/575] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:43:41 2022] DELETE /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73/os-volume_attachments/0e3f9b8a-37f9-46c2-a031-e28802f15696 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:43:42.081530 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bff01e77-f95d-48fd-a53b-36b07bafa785 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:42.082168 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-bff01e77-f95d-48fd-a53b-36b07bafa785 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:42.087995 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bff01e77-f95d-48fd-a53b-36b07bafa785 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:42.088475 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bff01e77-f95d-48fd-a53b-36b07bafa785 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:42.088906 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bff01e77-f95d-48fd-a53b-36b07bafa785 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:42.089591 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bff01e77-f95d-48fd-a53b-36b07bafa785 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:42.090040 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bff01e77-f95d-48fd-a53b-36b07bafa785 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:42.090460 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bff01e77-f95d-48fd-a53b-36b07bafa785 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:42.219770 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-bff01e77-f95d-48fd-a53b-36b07bafa785 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:42.227329 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-bff01e77-f95d-48fd-a53b-36b07bafa785 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.149630 Sep 13 06:43:42.227910 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 294/576] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:42 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:42.680608 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-53e16dbf-a46b-40c1-b1a1-24c95b20afcf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:42.681348 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-53e16dbf-a46b-40c1-b1a1-24c95b20afcf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:42.687343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53e16dbf-a46b-40c1-b1a1-24c95b20afcf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:42.687855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53e16dbf-a46b-40c1-b1a1-24c95b20afcf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:42.688286 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53e16dbf-a46b-40c1-b1a1-24c95b20afcf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:42.688964 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53e16dbf-a46b-40c1-b1a1-24c95b20afcf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:42.689413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53e16dbf-a46b-40c1-b1a1-24c95b20afcf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:42.689830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53e16dbf-a46b-40c1-b1a1-24c95b20afcf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:42.819119 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-53e16dbf-a46b-40c1-b1a1-24c95b20afcf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:42.827476 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-53e16dbf-a46b-40c1-b1a1-24c95b20afcf tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.151715 Sep 13 06:43:42.828049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 283/577] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:42 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:43.250466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7566b8ed-42d0-4bcc-8de9-1e364fbb30ef tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:43.250999 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7566b8ed-42d0-4bcc-8de9-1e364fbb30ef tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:43.258307 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7566b8ed-42d0-4bcc-8de9-1e364fbb30ef tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:43.258795 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7566b8ed-42d0-4bcc-8de9-1e364fbb30ef tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:43.259235 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7566b8ed-42d0-4bcc-8de9-1e364fbb30ef tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:43.259961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7566b8ed-42d0-4bcc-8de9-1e364fbb30ef tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:43.260417 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7566b8ed-42d0-4bcc-8de9-1e364fbb30ef tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:43.260842 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7566b8ed-42d0-4bcc-8de9-1e364fbb30ef tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:43.387015 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7566b8ed-42d0-4bcc-8de9-1e364fbb30ef tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:43.394629 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7566b8ed-42d0-4bcc-8de9-1e364fbb30ef tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.148024 Sep 13 06:43:43.395202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 295/578] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:43 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:43.850939 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a1c80731-cbd7-4990-bb0b-214e3fd77d8f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:43.851509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a1c80731-cbd7-4990-bb0b-214e3fd77d8f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:43.857967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a1c80731-cbd7-4990-bb0b-214e3fd77d8f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:43.858443 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a1c80731-cbd7-4990-bb0b-214e3fd77d8f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:43.858901 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a1c80731-cbd7-4990-bb0b-214e3fd77d8f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:43.859634 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a1c80731-cbd7-4990-bb0b-214e3fd77d8f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:43.860071 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a1c80731-cbd7-4990-bb0b-214e3fd77d8f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:43.860489 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a1c80731-cbd7-4990-bb0b-214e3fd77d8f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:43.986645 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a1c80731-cbd7-4990-bb0b-214e3fd77d8f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:43.995579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a1c80731-cbd7-4990-bb0b-214e3fd77d8f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.148404 Sep 13 06:43:43.996147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 284/579] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:43 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:44.095311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-43b78e20-55fc-4e1f-a5b6-f7613c58e362 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:44.095849 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-43b78e20-55fc-4e1f-a5b6-f7613c58e362 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:44.102217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43b78e20-55fc-4e1f-a5b6-f7613c58e362 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:44.103143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43b78e20-55fc-4e1f-a5b6-f7613c58e362 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:44.103605 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43b78e20-55fc-4e1f-a5b6-f7613c58e362 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:44.104294 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43b78e20-55fc-4e1f-a5b6-f7613c58e362 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:44.104751 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43b78e20-55fc-4e1f-a5b6-f7613c58e362 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:44.105175 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-43b78e20-55fc-4e1f-a5b6-f7613c58e362 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:44.130186 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-43b78e20-55fc-4e1f-a5b6-f7613c58e362 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:43:44.204813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-43b78e20-55fc-4e1f-a5b6-f7613c58e362 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 204 len: 0 microversion: 2.1 time: 0.112908 Sep 13 06:43:44.205875 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 296/580] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:43:44 2022] DELETE /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:43:44.213940 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f02bdd8f-8e0d-4f05-aad3-1e7215f4cfd0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:44.214550 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f02bdd8f-8e0d-4f05-aad3-1e7215f4cfd0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:44.220375 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f02bdd8f-8e0d-4f05-aad3-1e7215f4cfd0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:44.220856 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f02bdd8f-8e0d-4f05-aad3-1e7215f4cfd0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:44.221291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f02bdd8f-8e0d-4f05-aad3-1e7215f4cfd0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:44.221975 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f02bdd8f-8e0d-4f05-aad3-1e7215f4cfd0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:44.222428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f02bdd8f-8e0d-4f05-aad3-1e7215f4cfd0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:44.222850 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f02bdd8f-8e0d-4f05-aad3-1e7215f4cfd0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:44.351780 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f02bdd8f-8e0d-4f05-aad3-1e7215f4cfd0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:44.359509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f02bdd8f-8e0d-4f05-aad3-1e7215f4cfd0 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1513 microversion: 2.1 time: 0.149255 Sep 13 06:43:44.360007 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 285/581] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:44 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:44.418717 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-09c76a32-4f3c-48a8-9da2-056065e69c50 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:44.419473 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-09c76a32-4f3c-48a8-9da2-056065e69c50 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:44.425666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-09c76a32-4f3c-48a8-9da2-056065e69c50 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:44.426141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-09c76a32-4f3c-48a8-9da2-056065e69c50 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:44.426576 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-09c76a32-4f3c-48a8-9da2-056065e69c50 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:44.427255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-09c76a32-4f3c-48a8-9da2-056065e69c50 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:44.427763 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-09c76a32-4f3c-48a8-9da2-056065e69c50 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:44.428205 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-09c76a32-4f3c-48a8-9da2-056065e69c50 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:44.559232 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-09c76a32-4f3c-48a8-9da2-056065e69c50 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:44.566824 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-09c76a32-4f3c-48a8-9da2-056065e69c50 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.152253 Sep 13 06:43:44.567409 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 297/582] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:44 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:45.018008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-29ec5ca4-3315-4b72-8ab3-3e71d6d4c6ac tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:45.018619 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-29ec5ca4-3315-4b72-8ab3-3e71d6d4c6ac tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:45.027273 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29ec5ca4-3315-4b72-8ab3-3e71d6d4c6ac tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:45.028164 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29ec5ca4-3315-4b72-8ab3-3e71d6d4c6ac tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:45.028881 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29ec5ca4-3315-4b72-8ab3-3e71d6d4c6ac tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:45.029594 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29ec5ca4-3315-4b72-8ab3-3e71d6d4c6ac tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:45.030061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29ec5ca4-3315-4b72-8ab3-3e71d6d4c6ac tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:45.030495 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29ec5ca4-3315-4b72-8ab3-3e71d6d4c6ac tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:45.156901 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-29ec5ca4-3315-4b72-8ab3-3e71d6d4c6ac tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:45.165239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-29ec5ca4-3315-4b72-8ab3-3e71d6d4c6ac tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.151095 Sep 13 06:43:45.165798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 286/583] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:45 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:45.382462 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d0183f11-b036-48b1-985c-145c71b94d52 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:45.382994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d0183f11-b036-48b1-985c-145c71b94d52 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:45.388901 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d0183f11-b036-48b1-985c-145c71b94d52 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:45.389379 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d0183f11-b036-48b1-985c-145c71b94d52 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:45.389807 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d0183f11-b036-48b1-985c-145c71b94d52 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:45.390486 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d0183f11-b036-48b1-985c-145c71b94d52 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:45.390936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d0183f11-b036-48b1-985c-145c71b94d52 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:45.391377 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d0183f11-b036-48b1-985c-145c71b94d52 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:45.517860 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d0183f11-b036-48b1-985c-145c71b94d52 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:45.521370 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:45.526655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d0183f11-b036-48b1-985c-145c71b94d52 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1513 microversion: 2.1 time: 0.148664 Sep 13 06:43:45.527214 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 298/584] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:45 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:45.589771 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-99528567-0b41-431c-907e-ccc04daf2c43 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:45.590384 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-99528567-0b41-431c-907e-ccc04daf2c43 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:45.596541 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99528567-0b41-431c-907e-ccc04daf2c43 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:45.597033 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99528567-0b41-431c-907e-ccc04daf2c43 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:45.597476 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99528567-0b41-431c-907e-ccc04daf2c43 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:45.598170 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99528567-0b41-431c-907e-ccc04daf2c43 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:45.598631 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99528567-0b41-431c-907e-ccc04daf2c43 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:45.599066 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99528567-0b41-431c-907e-ccc04daf2c43 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:45.731930 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-99528567-0b41-431c-907e-ccc04daf2c43 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:45.739556 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-99528567-0b41-431c-907e-ccc04daf2c43 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.153682 Sep 13 06:43:45.740124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 287/585] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:45 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:46.189619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-74a98e02-6999-4e9d-8c3b-3442b31f253b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:46.190242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-74a98e02-6999-4e9d-8c3b-3442b31f253b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:46.198664 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74a98e02-6999-4e9d-8c3b-3442b31f253b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:46.199092 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74a98e02-6999-4e9d-8c3b-3442b31f253b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:46.199557 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74a98e02-6999-4e9d-8c3b-3442b31f253b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:46.200250 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74a98e02-6999-4e9d-8c3b-3442b31f253b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:46.200704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74a98e02-6999-4e9d-8c3b-3442b31f253b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:46.201129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74a98e02-6999-4e9d-8c3b-3442b31f253b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:46.329534 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-74a98e02-6999-4e9d-8c3b-3442b31f253b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:46.338261 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-74a98e02-6999-4e9d-8c3b-3442b31f253b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.153352 Sep 13 06:43:46.338820 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 299/586] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:46 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:46.549841 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-28592d59-ddce-4d1b-9435-042d34a21c83 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:46.550447 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-28592d59-ddce-4d1b-9435-042d34a21c83 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:46.557562 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-28592d59-ddce-4d1b-9435-042d34a21c83 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:46.558053 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-28592d59-ddce-4d1b-9435-042d34a21c83 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:46.558515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-28592d59-ddce-4d1b-9435-042d34a21c83 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:46.559232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-28592d59-ddce-4d1b-9435-042d34a21c83 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:46.559713 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-28592d59-ddce-4d1b-9435-042d34a21c83 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:46.560138 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-28592d59-ddce-4d1b-9435-042d34a21c83 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:46.686512 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-28592d59-ddce-4d1b-9435-042d34a21c83 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:46.694748 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-28592d59-ddce-4d1b-9435-042d34a21c83 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1513 microversion: 2.1 time: 0.148801 Sep 13 06:43:46.695305 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 288/587] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:46 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:46.763144 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0554bcdb-c023-4dcd-b1c3-f1f89574e67b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:46.763926 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0554bcdb-c023-4dcd-b1c3-f1f89574e67b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:46.770304 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0554bcdb-c023-4dcd-b1c3-f1f89574e67b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:46.770800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0554bcdb-c023-4dcd-b1c3-f1f89574e67b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:46.771237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0554bcdb-c023-4dcd-b1c3-f1f89574e67b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:46.771959 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0554bcdb-c023-4dcd-b1c3-f1f89574e67b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:46.772421 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0554bcdb-c023-4dcd-b1c3-f1f89574e67b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:46.772846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0554bcdb-c023-4dcd-b1c3-f1f89574e67b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:46.906340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0554bcdb-c023-4dcd-b1c3-f1f89574e67b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:46.914541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0554bcdb-c023-4dcd-b1c3-f1f89574e67b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.154934 Sep 13 06:43:46.915111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 300/588] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:46 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:47.218420 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-68bc4a64-abc1-4162-a850-22040ff4d291 req-352af17d-9eab-489f-a5a8-672e7b19715f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2b8671-ddea-4699-94a6-a8dfb479ed73", "name": "network-vif-deleted", "tag": "175d99ec-de43-4157-936c-69701073bdd1"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:43:47.228696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-68bc4a64-abc1-4162-a850-22040ff4d291 req-352af17d-9eab-489f-a5a8-672e7b19715f service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:47.229164 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-68bc4a64-abc1-4162-a850-22040ff4d291 req-352af17d-9eab-489f-a5a8-672e7b19715f service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:47.229581 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-68bc4a64-abc1-4162-a850-22040ff4d291 req-352af17d-9eab-489f-a5a8-672e7b19715f service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:47.241091 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-68bc4a64-abc1-4162-a850-22040ff4d291 req-352af17d-9eab-489f-a5a8-672e7b19715f service nova] Creating event network-vif-deleted:175d99ec-de43-4157-936c-69701073bdd1 for instance 7f2b8671-ddea-4699-94a6-a8dfb479ed73 on hv-cinder-85638 Sep 13 06:43:47.246447 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-68bc4a64-abc1-4162-a850-22040ff4d291 req-352af17d-9eab-489f-a5a8-672e7b19715f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031589 Sep 13 06:43:47.247177 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 289/589] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:43:47.361227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-49717972-b1d0-49c8-be88-b536528cb0fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:47.361749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-49717972-b1d0-49c8-be88-b536528cb0fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:47.369691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49717972-b1d0-49c8-be88-b536528cb0fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:47.370196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49717972-b1d0-49c8-be88-b536528cb0fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:47.370636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49717972-b1d0-49c8-be88-b536528cb0fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:47.371485 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49717972-b1d0-49c8-be88-b536528cb0fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:47.371938 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49717972-b1d0-49c8-be88-b536528cb0fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:47.372356 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-49717972-b1d0-49c8-be88-b536528cb0fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:47.507693 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-49717972-b1d0-49c8-be88-b536528cb0fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:47.515911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-49717972-b1d0-49c8-be88-b536528cb0fd tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.158595 Sep 13 06:43:47.516471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 301/590] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:47 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:47.717985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:47.718715 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:47.725306 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:47.725789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:47.726225 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:47.726963 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:47.727452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:47.727900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:47.758180 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:47.758655 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:47.759085 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:47.759560 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lazy-loading 'fault' on Instance uuid 7f2b8671-ddea-4699-94a6-a8dfb479ed73 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:43:47.800283 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4250279832584ec4a77ce899e850b848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5140d3b3124d4fbbb3859a597710cf48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:47.808585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-18b3fc65-e5f3-4642-9d70-e4478fdab770 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 200 len: 1309 microversion: 2.1 time: 0.095214 Sep 13 06:43:47.809157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 290/591] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:47 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:47.939545 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6c6ba019-0033-4b9a-a9ef-113f4989f588 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:47.940148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6c6ba019-0033-4b9a-a9ef-113f4989f588 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:47.946485 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c6ba019-0033-4b9a-a9ef-113f4989f588 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:47.946970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c6ba019-0033-4b9a-a9ef-113f4989f588 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:47.947424 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c6ba019-0033-4b9a-a9ef-113f4989f588 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:47.948116 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c6ba019-0033-4b9a-a9ef-113f4989f588 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:47.948562 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c6ba019-0033-4b9a-a9ef-113f4989f588 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:47.948975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6c6ba019-0033-4b9a-a9ef-113f4989f588 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:48.092185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6c6ba019-0033-4b9a-a9ef-113f4989f588 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:48.100755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6c6ba019-0033-4b9a-a9ef-113f4989f588 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.166697 Sep 13 06:43:48.101407 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 302/592] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:47 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:48.540679 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c9f0f017-e889-4e18-a04e-0517911dcab6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:48.541290 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c9f0f017-e889-4e18-a04e-0517911dcab6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:48.547073 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9f0f017-e889-4e18-a04e-0517911dcab6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:48.547603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9f0f017-e889-4e18-a04e-0517911dcab6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:48.548035 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9f0f017-e889-4e18-a04e-0517911dcab6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:48.548715 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9f0f017-e889-4e18-a04e-0517911dcab6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:48.549168 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9f0f017-e889-4e18-a04e-0517911dcab6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:48.549588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c9f0f017-e889-4e18-a04e-0517911dcab6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:48.567476 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:48.680967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c9f0f017-e889-4e18-a04e-0517911dcab6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:48.689079 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c9f0f017-e889-4e18-a04e-0517911dcab6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.153027 Sep 13 06:43:48.689643 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 291/593] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:48 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:48.831476 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:48.831997 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] [instance: 7f2b8671-ddea-4699-94a6-a8dfb479ed73] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:48.838362 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:48.838835 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:48.839258 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:48.839962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:48.840411 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:48.840826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:48.854301 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] HTTP exception thrown: Instance 7f2b8671-ddea-4699-94a6-a8dfb479ed73 could not be found. Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Request method failure captured: Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 HTTP/1.1 Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICYYirS_37QDWRecuCHJiVG4QHzo8HqOoyMtYjFZO5X5PIAENXmR92O-6G81KRXYCbiU_DY8Bxwjbi9dWquDoeTPfYFffYwHa23tkGekTOtmLNr5E1YxLw_FfnvdLBH2n8OTLsYPm8-CUMaHj6hlpm1-QEXSNUcl0fUDxCmyo3eFsHI Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 5140d3b3124d4fbbb3859a597710cf48 Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-VolumesSnapshotTestJSON-137301379 Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:43:48.855929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5140d3b3124d4fbbb3859a597710cf48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5140d3b3124d4fbbb3859a597710cf48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5140d3b3124d4fbbb3859a597710cf48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5140d3b3124d4fbbb3859a597710cf48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-VolumesSnapshotTestJSON-137301379 Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 5140d3b3124d4fbbb3859a597710cf48 Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-137301379 Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-VolumesSnapshotTestJSON-137301379-project Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 4250279832584ec4a77ce899e850b848 Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-VolumesSnapshotTestJSON-137301379-project Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 7f2b8671-ddea-4699-94a6-a8dfb479ed73 could not be found. Sep 13 06:43:48.857477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '7f2b8671-ddea-4699-94a6-a8dfb479ed73'} Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f2b8671-ddea-4699-94a6-a8dfb479ed73 could not be found. Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:43:48.858394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f2b8671-ddea-4699-94a6-a8dfb479ed73 could not be found. Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f2b8671-ddea-4699-94a6-a8dfb479ed73 could not be found. Sep 13 06:43:48.859884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:43:48.861221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] Returning 404 to user: Instance 7f2b8671-ddea-4699-94a6-a8dfb479ed73 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:43:48.861221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2ab962db-ad29-4e56-97aa-97050fd76357 tempest-VolumesSnapshotTestJSON-137301379 tempest-VolumesSnapshotTestJSON-137301379-project] 10.222.0.17 "GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73" status: 404 len: 111 microversion: 2.1 time: 0.029726 Sep 13 06:43:48.861221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 303/594] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:48 2022] GET /compute/v2.1/servers/7f2b8671-ddea-4699-94a6-a8dfb479ed73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:43:49.123923 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5a11a6b9-5592-447d-8d42-7177f1791723 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:49.124676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5a11a6b9-5592-447d-8d42-7177f1791723 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:49.130806 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a11a6b9-5592-447d-8d42-7177f1791723 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:49.131299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a11a6b9-5592-447d-8d42-7177f1791723 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:49.131761 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a11a6b9-5592-447d-8d42-7177f1791723 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:49.132457 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a11a6b9-5592-447d-8d42-7177f1791723 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:49.132943 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a11a6b9-5592-447d-8d42-7177f1791723 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:49.133405 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5a11a6b9-5592-447d-8d42-7177f1791723 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:49.267427 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5a11a6b9-5592-447d-8d42-7177f1791723 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:49.275094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5a11a6b9-5592-447d-8d42-7177f1791723 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.155145 Sep 13 06:43:49.275694 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 292/595] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:49 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:49.712457 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4caea69d-8b08-4415-935b-cb11505121a0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:49.713070 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4caea69d-8b08-4415-935b-cb11505121a0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:49.719475 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4caea69d-8b08-4415-935b-cb11505121a0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:49.719958 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4caea69d-8b08-4415-935b-cb11505121a0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:49.720391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4caea69d-8b08-4415-935b-cb11505121a0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:49.721082 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4caea69d-8b08-4415-935b-cb11505121a0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:49.721533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4caea69d-8b08-4415-935b-cb11505121a0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:49.721954 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4caea69d-8b08-4415-935b-cb11505121a0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:49.849077 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4caea69d-8b08-4415-935b-cb11505121a0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:49.859020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4caea69d-8b08-4415-935b-cb11505121a0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.150785 Sep 13 06:43:49.859710 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 304/596] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:49 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:50.300089 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0d32bf0a-1fda-46bd-a49b-36655db75446 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:50.300824 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0d32bf0a-1fda-46bd-a49b-36655db75446 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:50.310101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0d32bf0a-1fda-46bd-a49b-36655db75446 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:50.310597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0d32bf0a-1fda-46bd-a49b-36655db75446 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:50.311034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0d32bf0a-1fda-46bd-a49b-36655db75446 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:50.311766 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0d32bf0a-1fda-46bd-a49b-36655db75446 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:50.312219 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0d32bf0a-1fda-46bd-a49b-36655db75446 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:50.312635 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0d32bf0a-1fda-46bd-a49b-36655db75446 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:50.444270 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0d32bf0a-1fda-46bd-a49b-36655db75446 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:50.451816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0d32bf0a-1fda-46bd-a49b-36655db75446 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.156411 Sep 13 06:43:50.452381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 293/597] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:50 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:50.881994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-925981fb-2cdb-41c0-b836-77c24116cd79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:50.882594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-925981fb-2cdb-41c0-b836-77c24116cd79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:50.889093 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-925981fb-2cdb-41c0-b836-77c24116cd79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:50.889615 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-925981fb-2cdb-41c0-b836-77c24116cd79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:50.890055 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-925981fb-2cdb-41c0-b836-77c24116cd79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:50.890781 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-925981fb-2cdb-41c0-b836-77c24116cd79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:50.891234 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-925981fb-2cdb-41c0-b836-77c24116cd79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:50.891709 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-925981fb-2cdb-41c0-b836-77c24116cd79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:51.022400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-925981fb-2cdb-41c0-b836-77c24116cd79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:51.030374 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-925981fb-2cdb-41c0-b836-77c24116cd79 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.152194 Sep 13 06:43:51.030937 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 305/598] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:50 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:51.475480 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-bc59661b-32ef-4008-9a40-228de2404b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:51.476093 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-bc59661b-32ef-4008-9a40-228de2404b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:51.482419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc59661b-32ef-4008-9a40-228de2404b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:51.482902 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc59661b-32ef-4008-9a40-228de2404b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:51.483334 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc59661b-32ef-4008-9a40-228de2404b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:51.484046 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc59661b-32ef-4008-9a40-228de2404b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:51.484503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc59661b-32ef-4008-9a40-228de2404b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:51.484928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc59661b-32ef-4008-9a40-228de2404b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:51.614027 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-bc59661b-32ef-4008-9a40-228de2404b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:51.622295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-bc59661b-32ef-4008-9a40-228de2404b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.151184 Sep 13 06:43:51.622860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 294/599] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:51 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:52.054306 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-107435b6-6192-4d76-9c88-c927af139429 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:52.054907 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-107435b6-6192-4d76-9c88-c927af139429 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:52.060992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107435b6-6192-4d76-9c88-c927af139429 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:52.061467 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107435b6-6192-4d76-9c88-c927af139429 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:52.061897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107435b6-6192-4d76-9c88-c927af139429 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:52.062578 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107435b6-6192-4d76-9c88-c927af139429 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:52.063032 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107435b6-6192-4d76-9c88-c927af139429 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:52.063485 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-107435b6-6192-4d76-9c88-c927af139429 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:52.191325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-107435b6-6192-4d76-9c88-c927af139429 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:52.199929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-107435b6-6192-4d76-9c88-c927af139429 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.149460 Sep 13 06:43:52.200481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 306/600] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:52 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:43:52.645302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-bae91439-4ba6-47a8-bb92-335f48f87d5e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:52.645871 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-bae91439-4ba6-47a8-bb92-335f48f87d5e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:52.652195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bae91439-4ba6-47a8-bb92-335f48f87d5e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:52.652679 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bae91439-4ba6-47a8-bb92-335f48f87d5e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:52.653109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bae91439-4ba6-47a8-bb92-335f48f87d5e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:52.653789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bae91439-4ba6-47a8-bb92-335f48f87d5e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:52.654240 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bae91439-4ba6-47a8-bb92-335f48f87d5e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:52.654660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bae91439-4ba6-47a8-bb92-335f48f87d5e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:52.779804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-bae91439-4ba6-47a8-bb92-335f48f87d5e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:52.787463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-bae91439-4ba6-47a8-bb92-335f48f87d5e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.146013 Sep 13 06:43:52.788023 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 295/601] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:52 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:53.223284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-318d2e8e-bd4d-454b-94f5-90afb667d058 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:53.223923 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-318d2e8e-bd4d-454b-94f5-90afb667d058 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:53.230732 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-318d2e8e-bd4d-454b-94f5-90afb667d058 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:53.231211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-318d2e8e-bd4d-454b-94f5-90afb667d058 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:53.231686 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-318d2e8e-bd4d-454b-94f5-90afb667d058 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:53.232374 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-318d2e8e-bd4d-454b-94f5-90afb667d058 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:53.232894 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-318d2e8e-bd4d-454b-94f5-90afb667d058 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:53.233316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-318d2e8e-bd4d-454b-94f5-90afb667d058 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:53.360931 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-318d2e8e-bd4d-454b-94f5-90afb667d058 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:53.369251 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-318d2e8e-bd4d-454b-94f5-90afb667d058 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.149794 Sep 13 06:43:53.370088 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 307/602] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:53 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:53.809963 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3a4b4c9d-eb60-40d5-92c2-55f7eb6e4b6d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:53.810569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3a4b4c9d-eb60-40d5-92c2-55f7eb6e4b6d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:53.816915 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a4b4c9d-eb60-40d5-92c2-55f7eb6e4b6d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:53.817389 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a4b4c9d-eb60-40d5-92c2-55f7eb6e4b6d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:53.817821 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a4b4c9d-eb60-40d5-92c2-55f7eb6e4b6d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:53.819001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a4b4c9d-eb60-40d5-92c2-55f7eb6e4b6d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:53.819571 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a4b4c9d-eb60-40d5-92c2-55f7eb6e4b6d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:53.819991 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a4b4c9d-eb60-40d5-92c2-55f7eb6e4b6d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:53.947413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3a4b4c9d-eb60-40d5-92c2-55f7eb6e4b6d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:53.955134 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3a4b4c9d-eb60-40d5-92c2-55f7eb6e4b6d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.149031 Sep 13 06:43:53.955728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 296/603] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:53 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:43:54.392737 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e10a2c74-049d-47d8-8606-4914d7c05afb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:54.393340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e10a2c74-049d-47d8-8606-4914d7c05afb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:54.399655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e10a2c74-049d-47d8-8606-4914d7c05afb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:54.400133 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e10a2c74-049d-47d8-8606-4914d7c05afb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:54.400561 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e10a2c74-049d-47d8-8606-4914d7c05afb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:54.401241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e10a2c74-049d-47d8-8606-4914d7c05afb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:54.401688 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e10a2c74-049d-47d8-8606-4914d7c05afb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:54.402103 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e10a2c74-049d-47d8-8606-4914d7c05afb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:54.540707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e10a2c74-049d-47d8-8606-4914d7c05afb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:54.549171 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e10a2c74-049d-47d8-8606-4914d7c05afb tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.160547 Sep 13 06:43:54.549860 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 308/604] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:54 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:54.978899 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9801fcb7-f3c9-4b91-88ea-453dffe0b44e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:54.980238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9801fcb7-f3c9-4b91-88ea-453dffe0b44e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:54.986604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9801fcb7-f3c9-4b91-88ea-453dffe0b44e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:54.987083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9801fcb7-f3c9-4b91-88ea-453dffe0b44e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:54.987558 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9801fcb7-f3c9-4b91-88ea-453dffe0b44e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:54.988244 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9801fcb7-f3c9-4b91-88ea-453dffe0b44e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:54.988694 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9801fcb7-f3c9-4b91-88ea-453dffe0b44e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:54.989124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9801fcb7-f3c9-4b91-88ea-453dffe0b44e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:55.118918 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9801fcb7-f3c9-4b91-88ea-453dffe0b44e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:55.126613 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9801fcb7-f3c9-4b91-88ea-453dffe0b44e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.151622 Sep 13 06:43:55.127180 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 297/605] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:54 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:55.573591 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0459dcdb-46af-488d-af1d-07d91c1f41a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:55.574211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0459dcdb-46af-488d-af1d-07d91c1f41a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:55.580170 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0459dcdb-46af-488d-af1d-07d91c1f41a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:55.580655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0459dcdb-46af-488d-af1d-07d91c1f41a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:55.581086 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0459dcdb-46af-488d-af1d-07d91c1f41a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:55.581772 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0459dcdb-46af-488d-af1d-07d91c1f41a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:55.582222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0459dcdb-46af-488d-af1d-07d91c1f41a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:55.582638 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0459dcdb-46af-488d-af1d-07d91c1f41a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:55.713025 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0459dcdb-46af-488d-af1d-07d91c1f41a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:55.721311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0459dcdb-46af-488d-af1d-07d91c1f41a6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.151536 Sep 13 06:43:55.722266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 309/606] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:55 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:56.149567 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-09c175d1-3605-4958-a8ab-06363f818998 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:56.150104 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-09c175d1-3605-4958-a8ab-06363f818998 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:56.156314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09c175d1-3605-4958-a8ab-06363f818998 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:56.156794 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09c175d1-3605-4958-a8ab-06363f818998 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:56.157231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09c175d1-3605-4958-a8ab-06363f818998 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:56.157911 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09c175d1-3605-4958-a8ab-06363f818998 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:56.158362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09c175d1-3605-4958-a8ab-06363f818998 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:56.158779 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09c175d1-3605-4958-a8ab-06363f818998 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:56.286598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-09c175d1-3605-4958-a8ab-06363f818998 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:56.295686 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-09c175d1-3605-4958-a8ab-06363f818998 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1677 microversion: 2.1 time: 0.150037 Sep 13 06:43:56.296244 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 298/607] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:56 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:56.744554 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ce8da7e0-dc11-45ee-b927-4637e105f360 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:56.745162 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ce8da7e0-dc11-45ee-b927-4637e105f360 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:56.752311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce8da7e0-dc11-45ee-b927-4637e105f360 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:56.752808 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce8da7e0-dc11-45ee-b927-4637e105f360 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:56.753243 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce8da7e0-dc11-45ee-b927-4637e105f360 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:56.753938 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce8da7e0-dc11-45ee-b927-4637e105f360 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:56.754391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce8da7e0-dc11-45ee-b927-4637e105f360 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:56.754811 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ce8da7e0-dc11-45ee-b927-4637e105f360 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:56.918400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ce8da7e0-dc11-45ee-b927-4637e105f360 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:56.926889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ce8da7e0-dc11-45ee-b927-4637e105f360 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.186164 Sep 13 06:43:56.935608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 310/608] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:56 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:57.320744 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-02c092a3-88fb-439e-a425-bb89b83b39f0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:57.321350 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-02c092a3-88fb-439e-a425-bb89b83b39f0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:57.327713 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02c092a3-88fb-439e-a425-bb89b83b39f0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:57.328198 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02c092a3-88fb-439e-a425-bb89b83b39f0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:57.328635 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02c092a3-88fb-439e-a425-bb89b83b39f0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:57.329320 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02c092a3-88fb-439e-a425-bb89b83b39f0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:57.329795 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02c092a3-88fb-439e-a425-bb89b83b39f0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:57.330202 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02c092a3-88fb-439e-a425-bb89b83b39f0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:57.467745 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-02c092a3-88fb-439e-a425-bb89b83b39f0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:57.479659 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-02c092a3-88fb-439e-a425-bb89b83b39f0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1654 microversion: 2.1 time: 0.163319 Sep 13 06:43:57.480229 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 299/609] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:57 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1654 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:57.502538 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e428b761-e880-439e-ac4a-591f7e0c303d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:43:57.508516 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e428b761-e880-439e-ac4a-591f7e0c303d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:57.508999 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e428b761-e880-439e-ac4a-591f7e0c303d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:57.509433 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e428b761-e880-439e-ac4a-591f7e0c303d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:57.530973 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e428b761-e880-439e-ac4a-591f7e0c303d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Going to try to start instance {{(pid=132399) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 06:43:57.574167 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e428b761-e880-439e-ac4a-591f7e0c303d tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/action" status: 202 len: 0 microversion: 2.1 time: 0.075397 Sep 13 06:43:57.574758 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 311/610] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:43:57 2022] POST /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:43:57.582799 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2f02ece8-c33d-4942-8a18-735fd92d9323 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:57.583434 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2f02ece8-c33d-4942-8a18-735fd92d9323 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:57.589395 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2f02ece8-c33d-4942-8a18-735fd92d9323 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:57.589886 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2f02ece8-c33d-4942-8a18-735fd92d9323 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:57.590351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2f02ece8-c33d-4942-8a18-735fd92d9323 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:57.591043 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2f02ece8-c33d-4942-8a18-735fd92d9323 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:57.591546 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2f02ece8-c33d-4942-8a18-735fd92d9323 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:57.591973 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2f02ece8-c33d-4942-8a18-735fd92d9323 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:57.728923 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2f02ece8-c33d-4942-8a18-735fd92d9323 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:57.736747 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2f02ece8-c33d-4942-8a18-735fd92d9323 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1663 microversion: 2.1 time: 0.157792 Sep 13 06:43:57.737313 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 300/611] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:57 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:57.950502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-911dcda0-68d5-4bfc-ad11-e572f9a44f67 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:57.951198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-911dcda0-68d5-4bfc-ad11-e572f9a44f67 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:57.957736 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-911dcda0-68d5-4bfc-ad11-e572f9a44f67 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:57.958218 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-911dcda0-68d5-4bfc-ad11-e572f9a44f67 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:57.959144 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-911dcda0-68d5-4bfc-ad11-e572f9a44f67 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:57.960086 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-911dcda0-68d5-4bfc-ad11-e572f9a44f67 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:57.960570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-911dcda0-68d5-4bfc-ad11-e572f9a44f67 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:57.960996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-911dcda0-68d5-4bfc-ad11-e572f9a44f67 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:58.098713 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-911dcda0-68d5-4bfc-ad11-e572f9a44f67 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:58.107674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-911dcda0-68d5-4bfc-ad11-e572f9a44f67 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.161338 Sep 13 06:43:58.108240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 312/612] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:57 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:58.760373 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f903599d-adc1-4553-b444-7bbe7c768514 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:58.760952 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f903599d-adc1-4553-b444-7bbe7c768514 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:58.767490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f903599d-adc1-4553-b444-7bbe7c768514 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:58.767981 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f903599d-adc1-4553-b444-7bbe7c768514 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:58.768408 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f903599d-adc1-4553-b444-7bbe7c768514 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:58.769103 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f903599d-adc1-4553-b444-7bbe7c768514 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:58.769555 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f903599d-adc1-4553-b444-7bbe7c768514 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:58.769974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f903599d-adc1-4553-b444-7bbe7c768514 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:58.967173 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f903599d-adc1-4553-b444-7bbe7c768514 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:58.975425 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f903599d-adc1-4553-b444-7bbe7c768514 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1663 microversion: 2.1 time: 0.218848 Sep 13 06:43:58.975983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 301/613] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:58 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1663 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:59.129864 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0bebd62c-aab2-4763-ab5b-ae5aed59c5c6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:43:59.130488 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0bebd62c-aab2-4763-ab5b-ae5aed59c5c6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:43:59.136791 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bebd62c-aab2-4763-ab5b-ae5aed59c5c6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:59.137266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bebd62c-aab2-4763-ab5b-ae5aed59c5c6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:59.137694 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bebd62c-aab2-4763-ab5b-ae5aed59c5c6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:59.138373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bebd62c-aab2-4763-ab5b-ae5aed59c5c6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:43:59.138823 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bebd62c-aab2-4763-ab5b-ae5aed59c5c6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:43:59.139256 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bebd62c-aab2-4763-ab5b-ae5aed59c5c6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:43:59.271181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0bebd62c-aab2-4763-ab5b-ae5aed59c5c6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:43:59.279708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0bebd62c-aab2-4763-ab5b-ae5aed59c5c6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1735 microversion: 2.1 time: 0.153563 Sep 13 06:43:59.289246 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 313/614] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:59 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:43:59.999193 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-29491b26-693a-46b2-bf12-1196b58425a7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:00.000105 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-29491b26-693a-46b2-bf12-1196b58425a7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:00.007113 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29491b26-693a-46b2-bf12-1196b58425a7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.007650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29491b26-693a-46b2-bf12-1196b58425a7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.008117 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29491b26-693a-46b2-bf12-1196b58425a7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.008855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29491b26-693a-46b2-bf12-1196b58425a7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.009318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29491b26-693a-46b2-bf12-1196b58425a7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.009748 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29491b26-693a-46b2-bf12-1196b58425a7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.140129 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-29491b26-693a-46b2-bf12-1196b58425a7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:00.148248 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-29491b26-693a-46b2-bf12-1196b58425a7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1667 microversion: 2.1 time: 0.153188 Sep 13 06:44:00.148807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 302/615] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:43:59 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:00.303956 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fc870638-b551-43dc-a7af-91f8921a4f3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:00.304558 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-fc870638-b551-43dc-a7af-91f8921a4f3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:00.311044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc870638-b551-43dc-a7af-91f8921a4f3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.311561 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc870638-b551-43dc-a7af-91f8921a4f3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.311993 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc870638-b551-43dc-a7af-91f8921a4f3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.312674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc870638-b551-43dc-a7af-91f8921a4f3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.313122 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc870638-b551-43dc-a7af-91f8921a4f3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.313540 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc870638-b551-43dc-a7af-91f8921a4f3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.443489 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fc870638-b551-43dc-a7af-91f8921a4f3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:00.451553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fc870638-b551-43dc-a7af-91f8921a4f3d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1715 microversion: 2.1 time: 0.151385 Sep 13 06:44:00.452115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 314/616] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:00 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:00.512411 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:00.512903 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:00.518698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.519182 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.519647 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.520335 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.520792 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.521764 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.553436 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-03dd7f60-c858-44f3-974b-c8ae138d11f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:00.553938 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-03dd7f60-c858-44f3-974b-c8ae138d11f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:00.559870 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03dd7f60-c858-44f3-974b-c8ae138d11f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.560360 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03dd7f60-c858-44f3-974b-c8ae138d11f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.560800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03dd7f60-c858-44f3-974b-c8ae138d11f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.561492 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03dd7f60-c858-44f3-974b-c8ae138d11f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.561949 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03dd7f60-c858-44f3-974b-c8ae138d11f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.562532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03dd7f60-c858-44f3-974b-c8ae138d11f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.566743 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:00.596416 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-03dd7f60-c858-44f3-974b-c8ae138d11f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:44:00.609983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] HTTP exception thrown: Cannot 'detach_volume' instance d2001137-a4ff-4946-bc5e-56f38c00f36e while it is in vm_state rescued Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Request method failure captured: Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: DELETE /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments/b1646bb9-d323-44f2-956c-9e2cd8a0c06d HTTP/1.1 Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUxj6MqqdqElfWqH5aL2gn96PspvAbbzhXgLFU2F58FTDBDdrp3Z0c7eG23xqOh3h_TUtlPq2VTks3rSAdpphS-zhqBW3JkCdCq4-0VW2eyujCWXjaQWWm-3_69zMNFPkvWhIwezm9zeAO9awvqOSnjKPXwSGxtcYdntZHsKh7LZj0 Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 2a2a801692c84c34b713aca165f69761 Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:44:00.611616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a2a801692c84c34b713aca165f69761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a2a801692c84c34b713aca165f69761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a2a801692c84c34b713aca165f69761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a2a801692c84c34b713aca165f69761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 2a2a801692c84c34b713aca165f69761 Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-ServerRescueNegativeTestJSON-1025991494-project Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 3a0a80a54cdc4107a508ca480b992319 Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1025991494-project Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:44:00.613218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Cannot 'detach_volume' instance d2001137-a4ff-4946-bc5e-56f38c00f36e while it is in vm_state rescued Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'server_id': 'd2001137-a4ff-4946-bc5e-56f38c00f36e', 'id': 'b1646bb9-d323-44f2-956c-9e2cd8a0c06d'} Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d2001137-a4ff-4946-bc5e-56f38c00f36e in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:44:00.613997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d2001137-a4ff-4946-bc5e-56f38c00f36e while it is in vm_state rescued Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d2001137-a4ff-4946-bc5e-56f38c00f36e while it is in vm_state rescued Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:00.615612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Returning 409 to user: Cannot 'detach_volume' instance d2001137-a4ff-4946-bc5e-56f38c00f36e while it is in vm_state rescued {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:44:00.616797 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5225ace4-720e-4e75-9cb7-f0cd1d22b793 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments/b1646bb9-d323-44f2-956c-9e2cd8a0c06d" status: 409 len: 152 microversion: 2.1 time: 0.104604 Sep 13 06:44:00.616797 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 303/617] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:44:00 2022] DELETE /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments/b1646bb9-d323-44f2-956c-9e2cd8a0c06d => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 06:44:00.621808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2354c422-575b-4d91-87d0-390e3b75db17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:00.622328 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2354c422-575b-4d91-87d0-390e3b75db17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:00.628136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2354c422-575b-4d91-87d0-390e3b75db17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.628641 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2354c422-575b-4d91-87d0-390e3b75db17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.629073 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2354c422-575b-4d91-87d0-390e3b75db17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.629757 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2354c422-575b-4d91-87d0-390e3b75db17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.630692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2354c422-575b-4d91-87d0-390e3b75db17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.631113 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2354c422-575b-4d91-87d0-390e3b75db17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.671454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-03dd7f60-c858-44f3-974b-c8ae138d11f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "DELETE /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 204 len: 0 microversion: 2.1 time: 0.121497 Sep 13 06:44:00.672044 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 315/618] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:44:00 2022] DELETE /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 06:44:00.681858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-81d163ff-012f-4ac3-887c-172d3b0fc7f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:00.682575 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-81d163ff-012f-4ac3-887c-172d3b0fc7f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:00.688284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-81d163ff-012f-4ac3-887c-172d3b0fc7f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.688767 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-81d163ff-012f-4ac3-887c-172d3b0fc7f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.689232 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-81d163ff-012f-4ac3-887c-172d3b0fc7f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.689919 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-81d163ff-012f-4ac3-887c-172d3b0fc7f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.690373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-81d163ff-012f-4ac3-887c-172d3b0fc7f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.690841 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-81d163ff-012f-4ac3-887c-172d3b0fc7f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.699934 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2354c422-575b-4d91-87d0-390e3b75db17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "POST /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/action" status: 202 len: 0 microversion: 2.1 time: 0.081526 Sep 13 06:44:00.703615 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 304/619] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:44:00 2022] POST /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 06:44:00.709057 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-605f5c57-c2fb-4db4-84ed-ffb149811b0d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:00.709761 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-605f5c57-c2fb-4db4-84ed-ffb149811b0d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:00.715730 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-605f5c57-c2fb-4db4-84ed-ffb149811b0d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.716216 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-605f5c57-c2fb-4db4-84ed-ffb149811b0d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.716653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-605f5c57-c2fb-4db4-84ed-ffb149811b0d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.717340 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-605f5c57-c2fb-4db4-84ed-ffb149811b0d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:00.717803 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-605f5c57-c2fb-4db4-84ed-ffb149811b0d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:00.718230 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-605f5c57-c2fb-4db4-84ed-ffb149811b0d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:00.825235 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-81d163ff-012f-4ac3-887c-172d3b0fc7f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:00.833087 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-81d163ff-012f-4ac3-887c-172d3b0fc7f3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1576 microversion: 2.1 time: 0.156651 Sep 13 06:44:00.834249 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 316/620] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:00 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:00.850530 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-605f5c57-c2fb-4db4-84ed-ffb149811b0d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:00.858662 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-605f5c57-c2fb-4db4-84ed-ffb149811b0d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1723 microversion: 2.1 time: 0.153690 Sep 13 06:44:00.859226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 305/621] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:00 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:01.856442 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8b8923af-e487-4b7e-a735-784ec01817c1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:01.856986 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8b8923af-e487-4b7e-a735-784ec01817c1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:01.863437 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b8923af-e487-4b7e-a735-784ec01817c1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:01.863923 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b8923af-e487-4b7e-a735-784ec01817c1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:01.864358 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b8923af-e487-4b7e-a735-784ec01817c1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:01.865054 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b8923af-e487-4b7e-a735-784ec01817c1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:01.865512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b8923af-e487-4b7e-a735-784ec01817c1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:01.865934 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8b8923af-e487-4b7e-a735-784ec01817c1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:01.881701 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-77ad9d27-ff19-46e2-a3e9-fa23e20a1fbe tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:01.882314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-77ad9d27-ff19-46e2-a3e9-fa23e20a1fbe tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:01.888685 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77ad9d27-ff19-46e2-a3e9-fa23e20a1fbe tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:01.889168 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77ad9d27-ff19-46e2-a3e9-fa23e20a1fbe tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:01.889603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77ad9d27-ff19-46e2-a3e9-fa23e20a1fbe tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:01.890298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77ad9d27-ff19-46e2-a3e9-fa23e20a1fbe tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:01.890756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77ad9d27-ff19-46e2-a3e9-fa23e20a1fbe tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:01.891183 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77ad9d27-ff19-46e2-a3e9-fa23e20a1fbe tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:02.001659 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8b8923af-e487-4b7e-a735-784ec01817c1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:02.009973 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8b8923af-e487-4b7e-a735-784ec01817c1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1576 microversion: 2.1 time: 0.157419 Sep 13 06:44:02.010549 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 317/622] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:01 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:02.025870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-77ad9d27-ff19-46e2-a3e9-fa23e20a1fbe tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:02.034197 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-77ad9d27-ff19-46e2-a3e9-fa23e20a1fbe tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1723 microversion: 2.1 time: 0.156398 Sep 13 06:44:02.034748 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 306/623] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:01 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:03.033697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f0a1958d-8c6a-43da-a148-d6943461227a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:03.034324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f0a1958d-8c6a-43da-a148-d6943461227a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:03.041351 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0a1958d-8c6a-43da-a148-d6943461227a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:03.041824 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0a1958d-8c6a-43da-a148-d6943461227a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:03.042249 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0a1958d-8c6a-43da-a148-d6943461227a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:03.042956 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0a1958d-8c6a-43da-a148-d6943461227a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:03.043430 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0a1958d-8c6a-43da-a148-d6943461227a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:03.043852 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0a1958d-8c6a-43da-a148-d6943461227a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:03.058733 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7298d6c0-1a9d-4253-b6ae-fa64f16d2570 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:03.059344 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7298d6c0-1a9d-4253-b6ae-fa64f16d2570 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:03.065587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7298d6c0-1a9d-4253-b6ae-fa64f16d2570 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:03.066071 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7298d6c0-1a9d-4253-b6ae-fa64f16d2570 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:03.066507 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7298d6c0-1a9d-4253-b6ae-fa64f16d2570 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:03.067200 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7298d6c0-1a9d-4253-b6ae-fa64f16d2570 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:03.067760 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7298d6c0-1a9d-4253-b6ae-fa64f16d2570 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:03.068190 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7298d6c0-1a9d-4253-b6ae-fa64f16d2570 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:03.072301 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:03.175545 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f0a1958d-8c6a-43da-a148-d6943461227a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:03.183231 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f0a1958d-8c6a-43da-a148-d6943461227a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1576 microversion: 2.1 time: 0.153389 Sep 13 06:44:03.183841 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 318/624] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:03 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:03.199183 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7298d6c0-1a9d-4253-b6ae-fa64f16d2570 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:03.207267 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7298d6c0-1a9d-4253-b6ae-fa64f16d2570 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1723 microversion: 2.1 time: 0.152361 Sep 13 06:44:03.207853 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 307/625] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:03 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:03.378890 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e46d0746-3918-482a-ba57-69425ab147a5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:03.381724 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e46d0746-3918-482a-ba57-69425ab147a5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:03.383794 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:03.389619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e46d0746-3918-482a-ba57-69425ab147a5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:03.390099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e46d0746-3918-482a-ba57-69425ab147a5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:03.390532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e46d0746-3918-482a-ba57-69425ab147a5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:03.391218 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e46d0746-3918-482a-ba57-69425ab147a5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:03.391708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e46d0746-3918-482a-ba57-69425ab147a5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:03.392127 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e46d0746-3918-482a-ba57-69425ab147a5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:03.462361 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e46d0746-3918-482a-ba57-69425ab147a5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "POST /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/action" status: 202 len: 0 microversion: 2.1 time: 0.087230 Sep 13 06:44:03.462972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 319/626] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:44:03 2022] POST /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:44:03.471225 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-77192ef5-1a51-4620-a8f8-70adbe6f5c6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:03.472158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-77192ef5-1a51-4620-a8f8-70adbe6f5c6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:03.473758 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=67 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:03.479444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77192ef5-1a51-4620-a8f8-70adbe6f5c6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:03.479930 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77192ef5-1a51-4620-a8f8-70adbe6f5c6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:03.480366 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77192ef5-1a51-4620-a8f8-70adbe6f5c6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:03.481053 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77192ef5-1a51-4620-a8f8-70adbe6f5c6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:03.481511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77192ef5-1a51-4620-a8f8-70adbe6f5c6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:03.481935 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77192ef5-1a51-4620-a8f8-70adbe6f5c6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:03.620841 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-77192ef5-1a51-4620-a8f8-70adbe6f5c6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:03.629011 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-77192ef5-1a51-4620-a8f8-70adbe6f5c6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1752 microversion: 2.1 time: 0.161559 Sep 13 06:44:03.629521 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 308/627] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:03 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:04.205931 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ad42e85a-7c15-4fbb-aaa7-eef8bb230e53 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:04.206626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ad42e85a-7c15-4fbb-aaa7-eef8bb230e53 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:04.213094 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad42e85a-7c15-4fbb-aaa7-eef8bb230e53 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:04.213617 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad42e85a-7c15-4fbb-aaa7-eef8bb230e53 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:04.214045 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad42e85a-7c15-4fbb-aaa7-eef8bb230e53 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:04.214752 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad42e85a-7c15-4fbb-aaa7-eef8bb230e53 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:04.215199 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad42e85a-7c15-4fbb-aaa7-eef8bb230e53 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:04.215644 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad42e85a-7c15-4fbb-aaa7-eef8bb230e53 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:04.230341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a704362f-a7d5-4a64-a086-a53f36dfad43 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:04.230947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a704362f-a7d5-4a64-a086-a53f36dfad43 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:04.237284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a704362f-a7d5-4a64-a086-a53f36dfad43 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:04.237764 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a704362f-a7d5-4a64-a086-a53f36dfad43 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:04.238194 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a704362f-a7d5-4a64-a086-a53f36dfad43 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:04.238878 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a704362f-a7d5-4a64-a086-a53f36dfad43 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:04.239331 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a704362f-a7d5-4a64-a086-a53f36dfad43 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:04.240426 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a704362f-a7d5-4a64-a086-a53f36dfad43 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:04.350590 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ad42e85a-7c15-4fbb-aaa7-eef8bb230e53 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:04.358231 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ad42e85a-7c15-4fbb-aaa7-eef8bb230e53 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1576 microversion: 2.1 time: 0.156460 Sep 13 06:44:04.358792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 320/628] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:04 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:04.373297 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a704362f-a7d5-4a64-a086-a53f36dfad43 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:04.381350 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a704362f-a7d5-4a64-a086-a53f36dfad43 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1723 microversion: 2.1 time: 0.154757 Sep 13 06:44:04.381903 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 309/629] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:04 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:04.653051 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3e47d502-e1ce-4ef7-bc36-ea7d18579695 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:04.653677 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3e47d502-e1ce-4ef7-bc36-ea7d18579695 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:04.659488 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e47d502-e1ce-4ef7-bc36-ea7d18579695 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:04.659972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e47d502-e1ce-4ef7-bc36-ea7d18579695 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:04.660406 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e47d502-e1ce-4ef7-bc36-ea7d18579695 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:04.661090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e47d502-e1ce-4ef7-bc36-ea7d18579695 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:04.662180 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e47d502-e1ce-4ef7-bc36-ea7d18579695 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:04.662601 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e47d502-e1ce-4ef7-bc36-ea7d18579695 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:04.807048 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3e47d502-e1ce-4ef7-bc36-ea7d18579695 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:04.816085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3e47d502-e1ce-4ef7-bc36-ea7d18579695 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1752 microversion: 2.1 time: 0.167039 Sep 13 06:44:04.816649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 321/630] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:04 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:05.381684 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b42a0e11-01af-4015-910b-7b2c425070fc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:05.382287 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b42a0e11-01af-4015-910b-7b2c425070fc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:05.388610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b42a0e11-01af-4015-910b-7b2c425070fc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:05.389091 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b42a0e11-01af-4015-910b-7b2c425070fc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:05.389554 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b42a0e11-01af-4015-910b-7b2c425070fc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:05.390235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b42a0e11-01af-4015-910b-7b2c425070fc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:05.390691 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b42a0e11-01af-4015-910b-7b2c425070fc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:05.391111 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b42a0e11-01af-4015-910b-7b2c425070fc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:05.404178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d4697f72-16b9-4316-81bc-ea695c788b4d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:05.404817 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d4697f72-16b9-4316-81bc-ea695c788b4d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:05.411063 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d4697f72-16b9-4316-81bc-ea695c788b4d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:05.412164 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d4697f72-16b9-4316-81bc-ea695c788b4d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:05.412599 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d4697f72-16b9-4316-81bc-ea695c788b4d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:05.413287 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d4697f72-16b9-4316-81bc-ea695c788b4d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:05.413742 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d4697f72-16b9-4316-81bc-ea695c788b4d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:05.414419 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d4697f72-16b9-4316-81bc-ea695c788b4d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:05.523821 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b42a0e11-01af-4015-910b-7b2c425070fc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:05.531662 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b42a0e11-01af-4015-910b-7b2c425070fc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1576 microversion: 2.1 time: 0.153781 Sep 13 06:44:05.532315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 310/631] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:05 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:05.543838 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d4697f72-16b9-4316-81bc-ea695c788b4d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:05.551960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d4697f72-16b9-4316-81bc-ea695c788b4d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1723 microversion: 2.1 time: 0.151623 Sep 13 06:44:05.552519 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 322/632] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:05 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:05.843655 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-dc40626c-6224-4bc0-8784-6f79ccc6e0d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:05.844186 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-dc40626c-6224-4bc0-8784-6f79ccc6e0d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:05.850370 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc40626c-6224-4bc0-8784-6f79ccc6e0d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:05.850863 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc40626c-6224-4bc0-8784-6f79ccc6e0d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:05.851299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc40626c-6224-4bc0-8784-6f79ccc6e0d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:05.852024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc40626c-6224-4bc0-8784-6f79ccc6e0d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:05.852472 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc40626c-6224-4bc0-8784-6f79ccc6e0d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:05.852893 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc40626c-6224-4bc0-8784-6f79ccc6e0d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:06.032354 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dc40626c-6224-4bc0-8784-6f79ccc6e0d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:06.049974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-dc40626c-6224-4bc0-8784-6f79ccc6e0d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1752 microversion: 2.1 time: 0.210300 Sep 13 06:44:06.050564 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 311/633] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:05 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1752 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:06.556977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-61170d9e-5608-46b4-9160-f8c33c35e96a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:06.557598 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-61170d9e-5608-46b4-9160-f8c33c35e96a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:06.563904 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-61170d9e-5608-46b4-9160-f8c33c35e96a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:06.564386 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-61170d9e-5608-46b4-9160-f8c33c35e96a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:06.564822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-61170d9e-5608-46b4-9160-f8c33c35e96a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:06.565509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-61170d9e-5608-46b4-9160-f8c33c35e96a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:06.565961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-61170d9e-5608-46b4-9160-f8c33c35e96a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:06.566387 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-61170d9e-5608-46b4-9160-f8c33c35e96a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:06.574444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-68f0d45d-89dd-4c92-bc58-42d86b3188ec tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:06.575134 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-68f0d45d-89dd-4c92-bc58-42d86b3188ec tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:06.582026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68f0d45d-89dd-4c92-bc58-42d86b3188ec tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:06.582756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68f0d45d-89dd-4c92-bc58-42d86b3188ec tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:06.583320 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68f0d45d-89dd-4c92-bc58-42d86b3188ec tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:06.583981 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68f0d45d-89dd-4c92-bc58-42d86b3188ec tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:06.584499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68f0d45d-89dd-4c92-bc58-42d86b3188ec tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:06.584958 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68f0d45d-89dd-4c92-bc58-42d86b3188ec tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:06.707298 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-61170d9e-5608-46b4-9160-f8c33c35e96a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:06.715066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-61170d9e-5608-46b4-9160-f8c33c35e96a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1576 microversion: 2.1 time: 0.163518 Sep 13 06:44:06.715668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 323/634] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:06 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:06.721022 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-68f0d45d-89dd-4c92-bc58-42d86b3188ec tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:06.730003 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-68f0d45d-89dd-4c92-bc58-42d86b3188ec tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1723 microversion: 2.1 time: 0.159689 Sep 13 06:44:06.730848 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 312/635] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:06 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:07.074318 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fcaceb05-b226-466b-819c-27d76e2b7f64 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:07.074928 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-fcaceb05-b226-466b-819c-27d76e2b7f64 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:07.080783 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcaceb05-b226-466b-819c-27d76e2b7f64 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:07.081332 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcaceb05-b226-466b-819c-27d76e2b7f64 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:07.081829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcaceb05-b226-466b-819c-27d76e2b7f64 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:07.082585 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcaceb05-b226-466b-819c-27d76e2b7f64 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:07.083107 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcaceb05-b226-466b-819c-27d76e2b7f64 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:07.083553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcaceb05-b226-466b-819c-27d76e2b7f64 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:07.242003 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fcaceb05-b226-466b-819c-27d76e2b7f64 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:07.250939 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fcaceb05-b226-466b-819c-27d76e2b7f64 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1752 microversion: 2.1 time: 0.180295 Sep 13 06:44:07.251987 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 324/636] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:07 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:07.738113 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-24cb2878-48b5-4c3f-815f-1636bd8b4f32 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:07.738825 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-24cb2878-48b5-4c3f-815f-1636bd8b4f32 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:07.747386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24cb2878-48b5-4c3f-815f-1636bd8b4f32 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:07.748212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24cb2878-48b5-4c3f-815f-1636bd8b4f32 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:07.748879 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24cb2878-48b5-4c3f-815f-1636bd8b4f32 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:07.749802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24cb2878-48b5-4c3f-815f-1636bd8b4f32 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:07.750588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24cb2878-48b5-4c3f-815f-1636bd8b4f32 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:07.751352 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-24cb2878-48b5-4c3f-815f-1636bd8b4f32 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:07.754564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-149efcd7-d356-4480-89ae-031b5a297a3f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:07.756718 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-149efcd7-d356-4480-89ae-031b5a297a3f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:07.763580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-149efcd7-d356-4480-89ae-031b5a297a3f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:07.764304 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-149efcd7-d356-4480-89ae-031b5a297a3f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:07.764737 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-149efcd7-d356-4480-89ae-031b5a297a3f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:07.765434 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-149efcd7-d356-4480-89ae-031b5a297a3f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:07.766042 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-149efcd7-d356-4480-89ae-031b5a297a3f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:07.766662 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-149efcd7-d356-4480-89ae-031b5a297a3f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:07.827692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-24cb2878-48b5-4c3f-815f-1636bd8b4f32 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:07.836523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-24cb2878-48b5-4c3f-815f-1636bd8b4f32 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1509 microversion: 2.1 time: 0.102285 Sep 13 06:44:07.837125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 313/637] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:07 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1509 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:07.907778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-149efcd7-d356-4480-89ae-031b5a297a3f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:07.916359 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-149efcd7-d356-4480-89ae-031b5a297a3f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1723 microversion: 2.1 time: 0.166133 Sep 13 06:44:07.916926 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 325/638] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:07 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:08.018788 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-194f94c5-a6c1-49e1-ace2-5560ba6433d2 req-18a4f86b-0761-4177-853e-fc76c9eb1133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462ba976-b35b-433e-b247-03eaef8428a5", "name": "network-vif-deleted", "tag": "15fd17c0-6cb3-46dd-adc1-2ec4c2d2560d"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:08.028558 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-194f94c5-a6c1-49e1-ace2-5560ba6433d2 req-18a4f86b-0761-4177-853e-fc76c9eb1133 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:08.029392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-194f94c5-a6c1-49e1-ace2-5560ba6433d2 req-18a4f86b-0761-4177-853e-fc76c9eb1133 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:08.029832 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-194f94c5-a6c1-49e1-ace2-5560ba6433d2 req-18a4f86b-0761-4177-853e-fc76c9eb1133 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:08.044045 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-194f94c5-a6c1-49e1-ace2-5560ba6433d2 req-18a4f86b-0761-4177-853e-fc76c9eb1133 service nova] Creating event network-vif-deleted:15fd17c0-6cb3-46dd-adc1-2ec4c2d2560d for instance 462ba976-b35b-433e-b247-03eaef8428a5 on hv-cinder-85638 Sep 13 06:44:08.049137 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-194f94c5-a6c1-49e1-ace2-5560ba6433d2 req-18a4f86b-0761-4177-853e-fc76c9eb1133 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034513 Sep 13 06:44:08.049904 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 314/639] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:08.274035 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-85d8518a-a364-45eb-bf89-17ccb3be5c4e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:08.274639 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-85d8518a-a364-45eb-bf89-17ccb3be5c4e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:08.280803 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85d8518a-a364-45eb-bf89-17ccb3be5c4e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:08.281305 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85d8518a-a364-45eb-bf89-17ccb3be5c4e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:08.281729 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85d8518a-a364-45eb-bf89-17ccb3be5c4e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:08.282494 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85d8518a-a364-45eb-bf89-17ccb3be5c4e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:08.282949 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85d8518a-a364-45eb-bf89-17ccb3be5c4e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:08.283507 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-85d8518a-a364-45eb-bf89-17ccb3be5c4e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:08.432781 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-85d8518a-a364-45eb-bf89-17ccb3be5c4e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:08.441694 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-85d8518a-a364-45eb-bf89-17ccb3be5c4e tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.171479 Sep 13 06:44:08.455388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 326/640] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:08 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:08.865796 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8ac017b0-2e50-4da6-a902-bccac9876638 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:08.867090 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8ac017b0-2e50-4da6-a902-bccac9876638 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:08.873872 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac017b0-2e50-4da6-a902-bccac9876638 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:08.874459 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac017b0-2e50-4da6-a902-bccac9876638 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:08.874972 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac017b0-2e50-4da6-a902-bccac9876638 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:08.875967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac017b0-2e50-4da6-a902-bccac9876638 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:08.876723 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac017b0-2e50-4da6-a902-bccac9876638 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:08.877412 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac017b0-2e50-4da6-a902-bccac9876638 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:08.940198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8fd7f9de-1e62-4d08-bf1f-db951870380f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:08.940815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8fd7f9de-1e62-4d08-bf1f-db951870380f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:08.948164 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8fd7f9de-1e62-4d08-bf1f-db951870380f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:08.952270 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8ac017b0-2e50-4da6-a902-bccac9876638 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:08.955693 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8fd7f9de-1e62-4d08-bf1f-db951870380f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:08.956398 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8fd7f9de-1e62-4d08-bf1f-db951870380f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:08.957325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8fd7f9de-1e62-4d08-bf1f-db951870380f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:08.958002 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8fd7f9de-1e62-4d08-bf1f-db951870380f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:08.958952 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8fd7f9de-1e62-4d08-bf1f-db951870380f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:08.968219 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8ac017b0-2e50-4da6-a902-bccac9876638 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1509 microversion: 2.1 time: 0.111501 Sep 13 06:44:08.968822 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 315/641] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:08 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1509 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:09.105160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8fd7f9de-1e62-4d08-bf1f-db951870380f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:09.113614 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8fd7f9de-1e62-4d08-bf1f-db951870380f tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1723 microversion: 2.1 time: 0.177244 Sep 13 06:44:09.114703 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 327/642] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:08 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:09.465844 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-70db1ed1-6b36-4d2f-8ab7-dfa89ee16989 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:09.466450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-70db1ed1-6b36-4d2f-8ab7-dfa89ee16989 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:09.472443 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70db1ed1-6b36-4d2f-8ab7-dfa89ee16989 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:09.472840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70db1ed1-6b36-4d2f-8ab7-dfa89ee16989 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:09.473274 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70db1ed1-6b36-4d2f-8ab7-dfa89ee16989 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:09.474664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70db1ed1-6b36-4d2f-8ab7-dfa89ee16989 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:09.475123 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70db1ed1-6b36-4d2f-8ab7-dfa89ee16989 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:09.475586 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-70db1ed1-6b36-4d2f-8ab7-dfa89ee16989 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:09.626457 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-70db1ed1-6b36-4d2f-8ab7-dfa89ee16989 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:09.636458 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-70db1ed1-6b36-4d2f-8ab7-dfa89ee16989 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.174423 Sep 13 06:44:09.637079 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 316/643] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:09 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:09.991056 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-69f4b661-6dcf-49a5-8d37-29c9858d05db tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:09.991727 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-69f4b661-6dcf-49a5-8d37-29c9858d05db tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:09.998295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-69f4b661-6dcf-49a5-8d37-29c9858d05db tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:09.998782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-69f4b661-6dcf-49a5-8d37-29c9858d05db tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:09.999222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-69f4b661-6dcf-49a5-8d37-29c9858d05db tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:10.000043 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-69f4b661-6dcf-49a5-8d37-29c9858d05db tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:10.000501 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-69f4b661-6dcf-49a5-8d37-29c9858d05db tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:10.000923 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-69f4b661-6dcf-49a5-8d37-29c9858d05db tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:10.064776 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-69f4b661-6dcf-49a5-8d37-29c9858d05db tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:10.072840 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-69f4b661-6dcf-49a5-8d37-29c9858d05db tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1225 microversion: 2.1 time: 0.085627 Sep 13 06:44:10.073441 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 328/644] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:09 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:10.138361 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1b8758ee-8d15-4368-937e-f6b49fd8cf62 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:10.139059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1b8758ee-8d15-4368-937e-f6b49fd8cf62 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:10.146024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b8758ee-8d15-4368-937e-f6b49fd8cf62 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:10.146514 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b8758ee-8d15-4368-937e-f6b49fd8cf62 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:10.146950 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b8758ee-8d15-4368-937e-f6b49fd8cf62 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:10.147675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b8758ee-8d15-4368-937e-f6b49fd8cf62 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:10.148142 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b8758ee-8d15-4368-937e-f6b49fd8cf62 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:10.148571 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b8758ee-8d15-4368-937e-f6b49fd8cf62 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:10.278587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1b8758ee-8d15-4368-937e-f6b49fd8cf62 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:10.286762 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1b8758ee-8d15-4368-937e-f6b49fd8cf62 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1723 microversion: 2.1 time: 0.152251 Sep 13 06:44:10.287332 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 317/645] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:10 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:10.660418 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-60fd5311-0d26-406c-bc8e-7d4318295269 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:10.661773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-60fd5311-0d26-406c-bc8e-7d4318295269 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:10.668026 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-60fd5311-0d26-406c-bc8e-7d4318295269 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:10.668501 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-60fd5311-0d26-406c-bc8e-7d4318295269 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:10.668933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-60fd5311-0d26-406c-bc8e-7d4318295269 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:10.669610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-60fd5311-0d26-406c-bc8e-7d4318295269 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:10.670052 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-60fd5311-0d26-406c-bc8e-7d4318295269 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:10.670465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-60fd5311-0d26-406c-bc8e-7d4318295269 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:10.675078 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:10.828149 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-60fd5311-0d26-406c-bc8e-7d4318295269 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:10.837049 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-60fd5311-0d26-406c-bc8e-7d4318295269 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.180412 Sep 13 06:44:10.837613 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 329/646] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:10 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:11.095974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:11.096609 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:11.102512 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:11.102988 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:11.103441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:11.104138 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:11.104591 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:11.105008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:11.137274 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:11.137757 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:11.138188 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:11.138636 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lazy-loading 'fault' on Instance uuid 462ba976-b35b-433e-b247-03eaef8428a5 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:44:11.180575 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:11.190753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7b71e99d-5403-462b-8bdf-2db998fcbf2e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 200 len: 1230 microversion: 2.1 time: 0.097625 Sep 13 06:44:11.190753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 318/647] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:11 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:11.310562 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f57d3a23-c59a-4a38-905d-7ba6904c534b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:11.311109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f57d3a23-c59a-4a38-905d-7ba6904c534b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:11.318110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f57d3a23-c59a-4a38-905d-7ba6904c534b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:11.318594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f57d3a23-c59a-4a38-905d-7ba6904c534b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:11.319031 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f57d3a23-c59a-4a38-905d-7ba6904c534b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:11.319750 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f57d3a23-c59a-4a38-905d-7ba6904c534b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:11.320209 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f57d3a23-c59a-4a38-905d-7ba6904c534b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:11.320633 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f57d3a23-c59a-4a38-905d-7ba6904c534b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:11.452509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f57d3a23-c59a-4a38-905d-7ba6904c534b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:11.464619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f57d3a23-c59a-4a38-905d-7ba6904c534b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1729 microversion: 2.1 time: 0.158162 Sep 13 06:44:11.466146 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 330/648] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:11 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:11.496534 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-17fb1739-5cdb-4aab-98bd-1c861878ed38 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:11.497040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-17fb1739-5cdb-4aab-98bd-1c861878ed38 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:11.502817 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17fb1739-5cdb-4aab-98bd-1c861878ed38 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:11.503305 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17fb1739-5cdb-4aab-98bd-1c861878ed38 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:11.503773 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17fb1739-5cdb-4aab-98bd-1c861878ed38 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:11.504467 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17fb1739-5cdb-4aab-98bd-1c861878ed38 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:11.505591 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17fb1739-5cdb-4aab-98bd-1c861878ed38 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:11.506023 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17fb1739-5cdb-4aab-98bd-1c861878ed38 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:11.584513 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-17fb1739-5cdb-4aab-98bd-1c861878ed38 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092660 Sep 13 06:44:11.584513 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 319/649] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Sep 13 06:44:11 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:44:11.860953 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8f0c5d80-3181-433b-9414-e78c0045d743 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:11.861698 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8f0c5d80-3181-433b-9414-e78c0045d743 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:11.868655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8f0c5d80-3181-433b-9414-e78c0045d743 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:11.869152 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8f0c5d80-3181-433b-9414-e78c0045d743 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:11.869587 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8f0c5d80-3181-433b-9414-e78c0045d743 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:11.870320 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8f0c5d80-3181-433b-9414-e78c0045d743 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:11.870778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8f0c5d80-3181-433b-9414-e78c0045d743 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:11.871202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8f0c5d80-3181-433b-9414-e78c0045d743 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:12.033016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8f0c5d80-3181-433b-9414-e78c0045d743 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:12.042632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8f0c5d80-3181-433b-9414-e78c0045d743 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.185411 Sep 13 06:44:12.043509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 331/650] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:11 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:12.213307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:12.213918 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:12.219722 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:12.220208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:12.220639 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:12.221325 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:12.221835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:12.222343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:12.236211 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] HTTP exception thrown: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Request method failure captured: Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 HTTP/1.1 Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICWICMyK7_4dBjo20FNu48ZRRvnAVn71PlzkHxPiDTHfL8A5JA1lb0Dd0LBBVaHDwvxUpabUZ_82xTDVKm6hl2Jr9myYlbnlAMJlnt2iAaAFlMNbuXtE0Nl_I-BKHRPvbniERFogNcUUy-sRCWtK_rbLxZsjxRHzfKUaEI3qu_8kEZM Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 5d92a2cc741d45aba5ac112718389c22 Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:44:12.237882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 5d92a2cc741d45aba5ac112718389c22 Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-TestVolumeBootPattern-1653757791-project Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: ca7cb5590aff4b0283cd583b391a5ffe Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-TestVolumeBootPattern-1653757791-project Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:44:12.239259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '462ba976-b35b-433e-b247-03eaef8428a5'} Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:44:12.240092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:44:12.241295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:12.242376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Returning 404 to user: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:44:12.242376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-02aeb284-6b0f-4bee-9551-7597968262d4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 404 len: 111 microversion: 2.1 time: 0.030387 Sep 13 06:44:12.242376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 320/651] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:12 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:44:12.337202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1040525524", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-621610664", "security_groups": [{"name": "tempest-secgroup-smoke-209540783"}], "block_device_mapping_v2": [{"uuid": "ee8865b1-65f3-46f1-a21a-6bcd71957d32", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1bd1c3af-b1e3-4524-bee7-4fb25240d8e3"}]}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:12.463858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.network.neutron [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] validate_networks() for [('1bd1c3af-b1e3-4524-bee7-4fb25240d8e3', None, None, None, None, None)] {{(pid=132399) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:44:12.506072 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-2fb20d5c-bdd3-44be-915b-7ec34dd1ce96 req-6bf2787f-55c5-426c-b40f-f5eb7e986edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2001137-a4ff-4946-bc5e-56f38c00f36e", "tag": "48d46bd9-6b3e-4011-86f2-51e97c672d79"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:12.527511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-2fb20d5c-bdd3-44be-915b-7ec34dd1ce96 req-6bf2787f-55c5-426c-b40f-f5eb7e986edf service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:12.528429 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-2fb20d5c-bdd3-44be-915b-7ec34dd1ce96 req-6bf2787f-55c5-426c-b40f-f5eb7e986edf service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:12.532035 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-2fb20d5c-bdd3-44be-915b-7ec34dd1ce96 req-6bf2787f-55c5-426c-b40f-f5eb7e986edf service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:12.545300 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-2fb20d5c-bdd3-44be-915b-7ec34dd1ce96 req-6bf2787f-55c5-426c-b40f-f5eb7e986edf service nova] Creating event network-changed:48d46bd9-6b3e-4011-86f2-51e97c672d79 for instance d2001137-a4ff-4946-bc5e-56f38c00f36e on hv-cinder-85638 Sep 13 06:44:12.550768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-2fb20d5c-bdd3-44be-915b-7ec34dd1ce96 req-6bf2787f-55c5-426c-b40f-f5eb7e986edf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048398 Sep 13 06:44:12.551410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 321/652] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:13.066798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-178545c0-8452-40a2-af7d-72ebb17f224c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:13.068499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-178545c0-8452-40a2-af7d-72ebb17f224c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:13.075063 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-178545c0-8452-40a2-af7d-72ebb17f224c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:13.075888 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-178545c0-8452-40a2-af7d-72ebb17f224c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:13.076621 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-178545c0-8452-40a2-af7d-72ebb17f224c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:13.077552 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-178545c0-8452-40a2-af7d-72ebb17f224c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:13.078224 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-178545c0-8452-40a2-af7d-72ebb17f224c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:13.078863 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-178545c0-8452-40a2-af7d-72ebb17f224c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:13.081117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Flavor limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:44:13.081534 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Image limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:44:13.082009 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Flavor pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:44:13.082699 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Image pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:44:13.083164 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:44:13.093820 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:13.094299 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:13.094912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:13.095872 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:13.096496 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:13.097085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:13.115259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Getting quotas for project 5d92a2cc741d45aba5ac112718389c22. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:44:13.119763 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Getting quotas for user ca7cb5590aff4b0283cd583b391a5ffe and project 5d92a2cc741d45aba5ac112718389c22. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:44:13.263442 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Going to run 1 instances... {{(pid=132399) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:44:13.266641 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee8865b1-65f3-46f1-a21a-6bcd71957d32',volume_size=None,volume_type=None)] {{(pid=132399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:44:13.314153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-178545c0-8452-40a2-af7d-72ebb17f224c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:13.323053 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-178545c0-8452-40a2-af7d-72ebb17f224c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.260515 Sep 13 06:44:13.339382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 322/653] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:13 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:13.443598 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-93f1a5ab-9fa6-4146-9308-0eb3b8bf0eac tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.110602 Sep 13 06:44:13.450599 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 332/654] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:44:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 06:44:13.460703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3fc0f09f-ea28-4319-86d7-26c81b6a971e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:13.461614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3fc0f09f-ea28-4319-86d7-26c81b6a971e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:13.538618 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3fc0f09f-ea28-4319-86d7-26c81b6a971e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:13.547096 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3fc0f09f-ea28-4319-86d7-26c81b6a971e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1094 microversion: 2.1 time: 0.095099 Sep 13 06:44:13.551420 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 323/655] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:13 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:14.345922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-48f96d65-d028-4d9a-8ee2-43d587578639 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:14.346537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-48f96d65-d028-4d9a-8ee2-43d587578639 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:14.354170 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-48f96d65-d028-4d9a-8ee2-43d587578639 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:14.354887 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-48f96d65-d028-4d9a-8ee2-43d587578639 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:14.355327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-48f96d65-d028-4d9a-8ee2-43d587578639 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:14.356050 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-48f96d65-d028-4d9a-8ee2-43d587578639 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:14.356505 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-48f96d65-d028-4d9a-8ee2-43d587578639 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:14.356923 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-48f96d65-d028-4d9a-8ee2-43d587578639 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:14.505827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-48f96d65-d028-4d9a-8ee2-43d587578639 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:14.514354 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-48f96d65-d028-4d9a-8ee2-43d587578639 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.172269 Sep 13 06:44:14.514902 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 333/656] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:14 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:14.565939 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-a89cad1b-d717-40c5-8229-5fe901f9ce12 req-4d8d0c6c-8a0c-405f-b3a3-6e72febf0b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2001137-a4ff-4946-bc5e-56f38c00f36e", "tag": "48d46bd9-6b3e-4011-86f2-51e97c672d79"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:14.571895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2e1403c3-1014-4325-873c-397eb99d4f72 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:14.578587 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2e1403c3-1014-4325-873c-397eb99d4f72 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:14.584466 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a89cad1b-d717-40c5-8229-5fe901f9ce12 req-4d8d0c6c-8a0c-405f-b3a3-6e72febf0b8e service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:14.584861 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e1403c3-1014-4325-873c-397eb99d4f72 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:14.584974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a89cad1b-d717-40c5-8229-5fe901f9ce12 req-4d8d0c6c-8a0c-405f-b3a3-6e72febf0b8e service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:14.585380 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a89cad1b-d717-40c5-8229-5fe901f9ce12 req-4d8d0c6c-8a0c-405f-b3a3-6e72febf0b8e service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:14.585517 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e1403c3-1014-4325-873c-397eb99d4f72 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:14.585985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e1403c3-1014-4325-873c-397eb99d4f72 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:14.586742 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e1403c3-1014-4325-873c-397eb99d4f72 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:14.587252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e1403c3-1014-4325-873c-397eb99d4f72 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:14.587996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2e1403c3-1014-4325-873c-397eb99d4f72 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:14.600392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-a89cad1b-d717-40c5-8229-5fe901f9ce12 req-4d8d0c6c-8a0c-405f-b3a3-6e72febf0b8e service nova] Creating event network-changed:48d46bd9-6b3e-4011-86f2-51e97c672d79 for instance d2001137-a4ff-4946-bc5e-56f38c00f36e on hv-cinder-85638 Sep 13 06:44:14.605699 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-a89cad1b-d717-40c5-8229-5fe901f9ce12 req-4d8d0c6c-8a0c-405f-b3a3-6e72febf0b8e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043224 Sep 13 06:44:14.606656 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 324/657] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:44:14.667518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2e1403c3-1014-4325-873c-397eb99d4f72 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:14.675125 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2e1403c3-1014-4325-873c-397eb99d4f72 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1192 microversion: 2.1 time: 0.107553 Sep 13 06:44:14.675733 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 334/658] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:14 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:15.540407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-079f7549-e2a4-4040-9295-24428a94282b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:15.541224 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-079f7549-e2a4-4040-9295-24428a94282b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:15.548016 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-079f7549-e2a4-4040-9295-24428a94282b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:15.548650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-079f7549-e2a4-4040-9295-24428a94282b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:15.549180 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-079f7549-e2a4-4040-9295-24428a94282b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:15.550042 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-079f7549-e2a4-4040-9295-24428a94282b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:15.550588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-079f7549-e2a4-4040-9295-24428a94282b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:15.551119 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-079f7549-e2a4-4040-9295-24428a94282b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:15.699407 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4b4cf048-3ce4-4a8d-aea3-b6c4e3989521 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:15.700185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4b4cf048-3ce4-4a8d-aea3-b6c4e3989521 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:15.708479 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b4cf048-3ce4-4a8d-aea3-b6c4e3989521 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:15.708965 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b4cf048-3ce4-4a8d-aea3-b6c4e3989521 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:15.709612 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b4cf048-3ce4-4a8d-aea3-b6c4e3989521 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:15.710718 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b4cf048-3ce4-4a8d-aea3-b6c4e3989521 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:15.711242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b4cf048-3ce4-4a8d-aea3-b6c4e3989521 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:15.711966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4b4cf048-3ce4-4a8d-aea3-b6c4e3989521 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:15.785438 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4b4cf048-3ce4-4a8d-aea3-b6c4e3989521 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:15.795563 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4b4cf048-3ce4-4a8d-aea3-b6c4e3989521 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1210 microversion: 2.1 time: 0.099850 Sep 13 06:44:15.796058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 335/659] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:15 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:15.856010 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-079f7549-e2a4-4040-9295-24428a94282b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:15.865437 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-079f7549-e2a4-4040-9295-24428a94282b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.330427 Sep 13 06:44:15.866006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 325/660] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:15 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:16.732924 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-4f91a25f-d932-4e60-a5f0-9001ebe09a1c req-2e9188cd-eb5b-40b5-84b9-fa97f15db90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6c6b92-7678-4f2d-bf4c-908373527d92", "tag": "6d8cd90d-8dbe-4213-9fee-bf02025eca4d"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:16.743143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-4f91a25f-d932-4e60-a5f0-9001ebe09a1c req-2e9188cd-eb5b-40b5-84b9-fa97f15db90a service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:16.744365 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-4f91a25f-d932-4e60-a5f0-9001ebe09a1c req-2e9188cd-eb5b-40b5-84b9-fa97f15db90a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:16.744365 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-4f91a25f-d932-4e60-a5f0-9001ebe09a1c req-2e9188cd-eb5b-40b5-84b9-fa97f15db90a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:16.755582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-4f91a25f-d932-4e60-a5f0-9001ebe09a1c req-2e9188cd-eb5b-40b5-84b9-fa97f15db90a service nova] Creating event network-changed:6d8cd90d-8dbe-4213-9fee-bf02025eca4d for instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 on hv-cinder-85638 Sep 13 06:44:16.760516 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-4f91a25f-d932-4e60-a5f0-9001ebe09a1c req-2e9188cd-eb5b-40b5-84b9-fa97f15db90a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031262 Sep 13 06:44:16.761118 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 336/661] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:16.817460 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fd6c199c-0bd2-4bb3-b62c-af5d188005bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:16.818097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fd6c199c-0bd2-4bb3-b62c-af5d188005bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:16.824639 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd6c199c-0bd2-4bb3-b62c-af5d188005bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:16.825131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd6c199c-0bd2-4bb3-b62c-af5d188005bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:16.825588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd6c199c-0bd2-4bb3-b62c-af5d188005bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:16.826277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd6c199c-0bd2-4bb3-b62c-af5d188005bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:16.826721 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd6c199c-0bd2-4bb3-b62c-af5d188005bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:16.827138 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fd6c199c-0bd2-4bb3-b62c-af5d188005bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:16.888826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9dbabf48-4c9a-4c46-81a9-e3389ba7759c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:16.889541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9dbabf48-4c9a-4c46-81a9-e3389ba7759c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:16.896397 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9dbabf48-4c9a-4c46-81a9-e3389ba7759c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:16.896890 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9dbabf48-4c9a-4c46-81a9-e3389ba7759c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:16.897323 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9dbabf48-4c9a-4c46-81a9-e3389ba7759c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:16.898027 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9dbabf48-4c9a-4c46-81a9-e3389ba7759c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:16.898482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9dbabf48-4c9a-4c46-81a9-e3389ba7759c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:16.898903 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9dbabf48-4c9a-4c46-81a9-e3389ba7759c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:17.044881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9dbabf48-4c9a-4c46-81a9-e3389ba7759c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:17.053105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9dbabf48-4c9a-4c46-81a9-e3389ba7759c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.168709 Sep 13 06:44:17.053834 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 337/662] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:16 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:17.057409 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fd6c199c-0bd2-4bb3-b62c-af5d188005bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:17.066256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fd6c199c-0bd2-4bb3-b62c-af5d188005bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.252983 Sep 13 06:44:17.066833 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 326/663] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:16 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:18.076363 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-80301b0e-cf45-450e-82cf-e5da360e303c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:18.076971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-80301b0e-cf45-450e-82cf-e5da360e303c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:18.083476 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80301b0e-cf45-450e-82cf-e5da360e303c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:18.083962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80301b0e-cf45-450e-82cf-e5da360e303c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:18.084391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80301b0e-cf45-450e-82cf-e5da360e303c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:18.085076 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80301b0e-cf45-450e-82cf-e5da360e303c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:18.085520 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80301b0e-cf45-450e-82cf-e5da360e303c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:18.085935 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80301b0e-cf45-450e-82cf-e5da360e303c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:18.088950 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ef82c687-0588-4050-a2e0-20ad9ad4038d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:18.089562 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ef82c687-0588-4050-a2e0-20ad9ad4038d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:18.095886 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef82c687-0588-4050-a2e0-20ad9ad4038d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:18.096365 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef82c687-0588-4050-a2e0-20ad9ad4038d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:18.096808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef82c687-0588-4050-a2e0-20ad9ad4038d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:18.097501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef82c687-0588-4050-a2e0-20ad9ad4038d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:18.097965 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef82c687-0588-4050-a2e0-20ad9ad4038d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:18.098389 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef82c687-0588-4050-a2e0-20ad9ad4038d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:18.116772 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:18.234822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-80301b0e-cf45-450e-82cf-e5da360e303c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:18.236040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ef82c687-0588-4050-a2e0-20ad9ad4038d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:18.243557 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-80301b0e-cf45-450e-82cf-e5da360e303c tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.170928 Sep 13 06:44:18.244121 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 338/664] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:18 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:18.244451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ef82c687-0588-4050-a2e0-20ad9ad4038d tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.159221 Sep 13 06:44:18.245130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 327/665] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:18 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:19.270712 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-86b9ec95-afd7-4361-8eb5-25cf4bbc34f9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:19.271281 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-885f1440-1872-4bf5-bc10-eda17c63e374 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:19.271763 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-86b9ec95-afd7-4361-8eb5-25cf4bbc34f9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:19.271909 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-885f1440-1872-4bf5-bc10-eda17c63e374 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:19.279885 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86b9ec95-afd7-4361-8eb5-25cf4bbc34f9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:19.280151 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-885f1440-1872-4bf5-bc10-eda17c63e374 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:19.280367 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86b9ec95-afd7-4361-8eb5-25cf4bbc34f9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:19.280663 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-885f1440-1872-4bf5-bc10-eda17c63e374 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:19.280793 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86b9ec95-afd7-4361-8eb5-25cf4bbc34f9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:19.281111 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-885f1440-1872-4bf5-bc10-eda17c63e374 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:19.281486 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86b9ec95-afd7-4361-8eb5-25cf4bbc34f9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:19.281813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-885f1440-1872-4bf5-bc10-eda17c63e374 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:19.281936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86b9ec95-afd7-4361-8eb5-25cf4bbc34f9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:19.282263 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-885f1440-1872-4bf5-bc10-eda17c63e374 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:19.282379 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86b9ec95-afd7-4361-8eb5-25cf4bbc34f9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:19.282807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-885f1440-1872-4bf5-bc10-eda17c63e374 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:19.416507 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-86b9ec95-afd7-4361-8eb5-25cf4bbc34f9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:19.424074 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-86b9ec95-afd7-4361-8eb5-25cf4bbc34f9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.160079 Sep 13 06:44:19.424636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 339/666] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:19 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:19.428717 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-885f1440-1872-4bf5-bc10-eda17c63e374 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:19.436739 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-885f1440-1872-4bf5-bc10-eda17c63e374 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.172731 Sep 13 06:44:19.437296 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 328/667] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:19 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:20.447165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e72aa2a9-010c-48f9-89eb-db935c49af89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:20.447870 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e72aa2a9-010c-48f9-89eb-db935c49af89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:20.454085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e72aa2a9-010c-48f9-89eb-db935c49af89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:20.454557 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e72aa2a9-010c-48f9-89eb-db935c49af89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:20.454984 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e72aa2a9-010c-48f9-89eb-db935c49af89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:20.455687 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e72aa2a9-010c-48f9-89eb-db935c49af89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:20.456133 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e72aa2a9-010c-48f9-89eb-db935c49af89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:20.456547 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e72aa2a9-010c-48f9-89eb-db935c49af89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:20.460124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-dc071c66-3f11-46cc-8a9c-54232fb6bbc8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:20.460728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-dc071c66-3f11-46cc-8a9c-54232fb6bbc8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:20.466944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc071c66-3f11-46cc-8a9c-54232fb6bbc8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:20.467454 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc071c66-3f11-46cc-8a9c-54232fb6bbc8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:20.467888 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc071c66-3f11-46cc-8a9c-54232fb6bbc8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:20.468576 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc071c66-3f11-46cc-8a9c-54232fb6bbc8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:20.469024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc071c66-3f11-46cc-8a9c-54232fb6bbc8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:20.469443 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc071c66-3f11-46cc-8a9c-54232fb6bbc8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:20.597272 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e72aa2a9-010c-48f9-89eb-db935c49af89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:20.605748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e72aa2a9-010c-48f9-89eb-db935c49af89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.162356 Sep 13 06:44:20.606338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 340/668] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:20 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:20.610474 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dc071c66-3f11-46cc-8a9c-54232fb6bbc8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:20.618586 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-dc071c66-3f11-46cc-8a9c-54232fb6bbc8 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.162797 Sep 13 06:44:20.619142 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 329/669] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:20 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:21.628105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-78e1ac8f-e6dd-4eb7-84ae-fa897232f368 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:21.628711 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-78e1ac8f-e6dd-4eb7-84ae-fa897232f368 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:21.635630 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78e1ac8f-e6dd-4eb7-84ae-fa897232f368 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:21.636117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78e1ac8f-e6dd-4eb7-84ae-fa897232f368 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:21.636554 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78e1ac8f-e6dd-4eb7-84ae-fa897232f368 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:21.637242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78e1ac8f-e6dd-4eb7-84ae-fa897232f368 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:21.637693 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78e1ac8f-e6dd-4eb7-84ae-fa897232f368 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:21.638115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78e1ac8f-e6dd-4eb7-84ae-fa897232f368 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:21.641359 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f322042a-6719-4d91-bdd9-cdac49decb47 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:21.641964 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f322042a-6719-4d91-bdd9-cdac49decb47 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:21.649125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f322042a-6719-4d91-bdd9-cdac49decb47 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:21.649700 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f322042a-6719-4d91-bdd9-cdac49decb47 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:21.650138 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f322042a-6719-4d91-bdd9-cdac49decb47 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:21.650828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f322042a-6719-4d91-bdd9-cdac49decb47 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:21.651282 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f322042a-6719-4d91-bdd9-cdac49decb47 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:21.651730 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f322042a-6719-4d91-bdd9-cdac49decb47 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:21.774650 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-78e1ac8f-e6dd-4eb7-84ae-fa897232f368 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:21.782324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-78e1ac8f-e6dd-4eb7-84ae-fa897232f368 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.158140 Sep 13 06:44:21.782896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 341/670] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:21 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:21.799563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f322042a-6719-4d91-bdd9-cdac49decb47 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:21.808529 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f322042a-6719-4d91-bdd9-cdac49decb47 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.170886 Sep 13 06:44:21.809124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 330/671] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:21 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:22.805806 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b3ae0fed-2dbc-4523-ab90-32c7a30a110f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:22.806419 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b3ae0fed-2dbc-4523-ab90-32c7a30a110f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:22.812775 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b3ae0fed-2dbc-4523-ab90-32c7a30a110f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:22.813260 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b3ae0fed-2dbc-4523-ab90-32c7a30a110f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:22.813692 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b3ae0fed-2dbc-4523-ab90-32c7a30a110f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:22.814658 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b3ae0fed-2dbc-4523-ab90-32c7a30a110f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:22.815111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b3ae0fed-2dbc-4523-ab90-32c7a30a110f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:22.815568 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b3ae0fed-2dbc-4523-ab90-32c7a30a110f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:22.831161 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0abc9312-4056-4b70-a889-92421785f210 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:22.831840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0abc9312-4056-4b70-a889-92421785f210 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:22.838658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abc9312-4056-4b70-a889-92421785f210 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:22.839077 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abc9312-4056-4b70-a889-92421785f210 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:22.839545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abc9312-4056-4b70-a889-92421785f210 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:22.840237 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abc9312-4056-4b70-a889-92421785f210 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:22.840688 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abc9312-4056-4b70-a889-92421785f210 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:22.841110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0abc9312-4056-4b70-a889-92421785f210 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:22.918988 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 06:44:22.919206 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Tue Sep 13 06:44:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 (ip 10.222.0.17) !!! Sep 13 06:44:22.951138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b3ae0fed-2dbc-4523-ab90-32c7a30a110f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:22.958819 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b3ae0fed-2dbc-4523-ab90-32c7a30a110f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.157364 Sep 13 06:44:22.959477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 342/672] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:22 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:22.984253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0abc9312-4056-4b70-a889-92421785f210 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:22.993136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0abc9312-4056-4b70-a889-92421785f210 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.165720 Sep 13 06:44:22.993699 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 331/673] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:22 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:23.982217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-496f17fd-2c1b-4ba2-9f4c-78e4d8f33497 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:23.982856 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-496f17fd-2c1b-4ba2-9f4c-78e4d8f33497 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:23.984912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:23.985611 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=6 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:23.992015 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-496f17fd-2c1b-4ba2-9f4c-78e4d8f33497 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:23.992501 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-496f17fd-2c1b-4ba2-9f4c-78e4d8f33497 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:23.992933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-496f17fd-2c1b-4ba2-9f4c-78e4d8f33497 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:23.993623 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-496f17fd-2c1b-4ba2-9f4c-78e4d8f33497 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:23.994080 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-496f17fd-2c1b-4ba2-9f4c-78e4d8f33497 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:23.994504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-496f17fd-2c1b-4ba2-9f4c-78e4d8f33497 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:24.014923 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9d867649-2c68-4b36-893a-18909ab4ad3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:24.015563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9d867649-2c68-4b36-893a-18909ab4ad3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:24.017378 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:24.026065 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9d867649-2c68-4b36-893a-18909ab4ad3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:24.026546 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9d867649-2c68-4b36-893a-18909ab4ad3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:24.026974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9d867649-2c68-4b36-893a-18909ab4ad3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:24.027695 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9d867649-2c68-4b36-893a-18909ab4ad3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:24.028150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9d867649-2c68-4b36-893a-18909ab4ad3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:24.028570 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9d867649-2c68-4b36-893a-18909ab4ad3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:24.130458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-496f17fd-2c1b-4ba2-9f4c-78e4d8f33497 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:24.138146 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-496f17fd-2c1b-4ba2-9f4c-78e4d8f33497 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.159845 Sep 13 06:44:24.138719 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 343/674] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:23 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:24.169402 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9d867649-2c68-4b36-893a-18909ab4ad3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:24.177522 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9d867649-2c68-4b36-893a-18909ab4ad3a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1757 microversion: 2.1 time: 0.166336 Sep 13 06:44:24.178084 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 332/675] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:24 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:25.160253 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-441b36b7-7869-4d19-ab8c-fc71ea0bb80c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:25.161452 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-441b36b7-7869-4d19-ab8c-fc71ea0bb80c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:25.168024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-441b36b7-7869-4d19-ab8c-fc71ea0bb80c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:25.168499 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-441b36b7-7869-4d19-ab8c-fc71ea0bb80c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:25.168925 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-441b36b7-7869-4d19-ab8c-fc71ea0bb80c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:25.169602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-441b36b7-7869-4d19-ab8c-fc71ea0bb80c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:25.170048 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-441b36b7-7869-4d19-ab8c-fc71ea0bb80c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:25.170461 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-441b36b7-7869-4d19-ab8c-fc71ea0bb80c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:25.200226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e73be76c-8f80-4d72-9b4b-da4a0c08f941 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:25.200835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e73be76c-8f80-4d72-9b4b-da4a0c08f941 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:25.208097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e73be76c-8f80-4d72-9b4b-da4a0c08f941 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:25.208577 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e73be76c-8f80-4d72-9b4b-da4a0c08f941 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:25.209009 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e73be76c-8f80-4d72-9b4b-da4a0c08f941 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:25.209811 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e73be76c-8f80-4d72-9b4b-da4a0c08f941 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:25.210264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e73be76c-8f80-4d72-9b4b-da4a0c08f941 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:25.210885 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e73be76c-8f80-4d72-9b4b-da4a0c08f941 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:25.306879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-441b36b7-7869-4d19-ab8c-fc71ea0bb80c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:25.315517 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-441b36b7-7869-4d19-ab8c-fc71ea0bb80c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.158964 Sep 13 06:44:25.316104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 344/676] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:25 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:25.367171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e73be76c-8f80-4d72-9b4b-da4a0c08f941 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:25.375214 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e73be76c-8f80-4d72-9b4b-da4a0c08f941 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1760 microversion: 2.1 time: 0.178952 Sep 13 06:44:25.375828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 333/677] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:25 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1760 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:26.342906 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-021d57bb-f571-482e-b911-fc31d2c3f6e9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:26.343549 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-021d57bb-f571-482e-b911-fc31d2c3f6e9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:26.350608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-021d57bb-f571-482e-b911-fc31d2c3f6e9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:26.351090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-021d57bb-f571-482e-b911-fc31d2c3f6e9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:26.351552 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-021d57bb-f571-482e-b911-fc31d2c3f6e9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:26.352242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-021d57bb-f571-482e-b911-fc31d2c3f6e9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:26.352697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-021d57bb-f571-482e-b911-fc31d2c3f6e9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:26.353121 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-021d57bb-f571-482e-b911-fc31d2c3f6e9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:26.485830 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-021d57bb-f571-482e-b911-fc31d2c3f6e9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:26.493348 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-021d57bb-f571-482e-b911-fc31d2c3f6e9 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.154413 Sep 13 06:44:26.493912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 345/678] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:26 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:27.515857 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-731bc88f-22f7-4d95-b686-cdab4830278c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:27.516398 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-731bc88f-22f7-4d95-b686-cdab4830278c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:27.522708 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-731bc88f-22f7-4d95-b686-cdab4830278c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:27.523190 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-731bc88f-22f7-4d95-b686-cdab4830278c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:27.523669 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-731bc88f-22f7-4d95-b686-cdab4830278c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:27.524360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-731bc88f-22f7-4d95-b686-cdab4830278c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:27.524820 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-731bc88f-22f7-4d95-b686-cdab4830278c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:27.525248 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-731bc88f-22f7-4d95-b686-cdab4830278c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:27.670832 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-731bc88f-22f7-4d95-b686-cdab4830278c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:27.679159 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-731bc88f-22f7-4d95-b686-cdab4830278c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.167259 Sep 13 06:44:27.679841 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 334/679] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:27 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:28.343065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-e6bfbe92-8a5a-405c-903c-4d610fa5db20 req-d38e1600-e9a1-41b1-8cec-79de77e8b5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b6c6b92-7678-4f2d-bf4c-908373527d92", "name": "network-vif-plugged", "status": "completed", "tag": "6d8cd90d-8dbe-4213-9fee-bf02025eca4d"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:28.353929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-e6bfbe92-8a5a-405c-903c-4d610fa5db20 req-d38e1600-e9a1-41b1-8cec-79de77e8b5d1 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:28.354410 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-e6bfbe92-8a5a-405c-903c-4d610fa5db20 req-d38e1600-e9a1-41b1-8cec-79de77e8b5d1 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:28.354835 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-e6bfbe92-8a5a-405c-903c-4d610fa5db20 req-d38e1600-e9a1-41b1-8cec-79de77e8b5d1 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:28.366515 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-e6bfbe92-8a5a-405c-903c-4d610fa5db20 req-d38e1600-e9a1-41b1-8cec-79de77e8b5d1 service nova] Creating event network-vif-plugged:6d8cd90d-8dbe-4213-9fee-bf02025eca4d for instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 on hv-cinder-85638 Sep 13 06:44:28.371420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-e6bfbe92-8a5a-405c-903c-4d610fa5db20 req-d38e1600-e9a1-41b1-8cec-79de77e8b5d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032050 Sep 13 06:44:28.372016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 346/680] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:28.702088 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ef030acc-d681-415d-a9df-c6de2da2ea37 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:28.702836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ef030acc-d681-415d-a9df-c6de2da2ea37 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:28.709764 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef030acc-d681-415d-a9df-c6de2da2ea37 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:28.710251 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef030acc-d681-415d-a9df-c6de2da2ea37 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:28.710691 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef030acc-d681-415d-a9df-c6de2da2ea37 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:28.711413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef030acc-d681-415d-a9df-c6de2da2ea37 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:28.711871 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef030acc-d681-415d-a9df-c6de2da2ea37 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:28.712294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef030acc-d681-415d-a9df-c6de2da2ea37 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:28.839810 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ef030acc-d681-415d-a9df-c6de2da2ea37 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:28.847336 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ef030acc-d681-415d-a9df-c6de2da2ea37 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.149188 Sep 13 06:44:28.848533 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 335/681] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:28 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:29.524123 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-53718938-4520-4cca-8571-3c76722a2e97 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:29.524709 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-53718938-4520-4cca-8571-3c76722a2e97 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:29.530734 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53718938-4520-4cca-8571-3c76722a2e97 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:29.531214 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53718938-4520-4cca-8571-3c76722a2e97 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:29.531688 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53718938-4520-4cca-8571-3c76722a2e97 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:29.532376 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53718938-4520-4cca-8571-3c76722a2e97 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:29.532826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53718938-4520-4cca-8571-3c76722a2e97 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:29.533278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53718938-4520-4cca-8571-3c76722a2e97 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:29.556142 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-53718938-4520-4cca-8571-3c76722a2e97 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6/ips" status: 200 len: 150 microversion: 2.1 time: 0.246552 Sep 13 06:44:29.556682 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 347/682] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Sep 13 06:44:29 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6/ips => generated 150 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:29.568830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bb7600d-f65e-40fd-8c41-0fec79ad2e35"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:29.571199 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:29.577045 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:29.577525 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:29.577956 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:29.578644 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:29.579099 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:29.579564 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:29.657783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Invalid volume: volume 5bb7600d-f65e-40fd-8c41-0fec79ad2e35 is already attached to instances: 1af9e76b-6689-431b-a4c2-2d681d4098ba Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: POST /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6/os-volume_attachments HTTP/1.1 Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 74 Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:44:29.659508 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {"volumeAttachment": {"volumeId": "5bb7600d-f65e-40fd-8c41-0fec79ad2e35"}} Sep 13 06:44:29.661148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Invalid volume: volume 5bb7600d-f65e-40fd-8c41-0fec79ad2e35 is already attached to instances: 1af9e76b-6689-431b-a4c2-2d681d4098ba Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'server_id': 'd9177caf-8489-4764-a082-2ac3fd7c23c6', 'body': {'volumeAttachment': {'volumeId': '5bb7600d-f65e-40fd-8c41-0fec79ad2e35'}}} Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5bb7600d-f65e-40fd-8c41-0fec79ad2e35 is already attached to instances: 1af9e76b-6689-431b-a4c2-2d681d4098ba Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:29.662013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5bb7600d-f65e-40fd-8c41-0fec79ad2e35 is already attached to instances: 1af9e76b-6689-431b-a4c2-2d681d4098ba Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:29.663257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:44:29.664948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:44:29.664948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:44:29.664948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:44:29.664948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5bb7600d-f65e-40fd-8c41-0fec79ad2e35 is already attached to instances: 1af9e76b-6689-431b-a4c2-2d681d4098ba Sep 13 06:44:29.664948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:29.664948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 400 to user: Invalid volume: volume 5bb7600d-f65e-40fd-8c41-0fec79ad2e35 is already attached to instances: 1af9e76b-6689-431b-a4c2-2d681d4098ba {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:44:29.664948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7f2f1744-27c6-4940-a381-b5dbeb34c150 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096741 Sep 13 06:44:29.664948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 336/683] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:44:29 2022] POST /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 06:44:29.670134 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-80749c07-3643-4b49-847a-f5787145b843 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:29.670627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-80749c07-3643-4b49-847a-f5787145b843 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:29.677106 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80749c07-3643-4b49-847a-f5787145b843 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:29.677571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80749c07-3643-4b49-847a-f5787145b843 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:29.678005 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80749c07-3643-4b49-847a-f5787145b843 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:29.678688 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80749c07-3643-4b49-847a-f5787145b843 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:29.679138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80749c07-3643-4b49-847a-f5787145b843 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:29.679596 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80749c07-3643-4b49-847a-f5787145b843 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:29.683528 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:29.704214 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-80749c07-3643-4b49-847a-f5787145b843 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:44:29.776440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-80749c07-3643-4b49-847a-f5787145b843 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 204 len: 0 microversion: 2.1 time: 0.109832 Sep 13 06:44:29.777021 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 348/684] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:44:29 2022] DELETE /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:44:29.785657 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-91faca54-cf4d-4af3-910c-7c2c73d3ba16 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:29.786330 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-91faca54-cf4d-4af3-910c-7c2c73d3ba16 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:29.793737 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91faca54-cf4d-4af3-910c-7c2c73d3ba16 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:29.794225 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91faca54-cf4d-4af3-910c-7c2c73d3ba16 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:29.794668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91faca54-cf4d-4af3-910c-7c2c73d3ba16 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:29.795412 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91faca54-cf4d-4af3-910c-7c2c73d3ba16 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:29.795904 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91faca54-cf4d-4af3-910c-7c2c73d3ba16 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:29.796332 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91faca54-cf4d-4af3-910c-7c2c73d3ba16 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:29.871101 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0a5ea2ca-37a2-4784-92fa-a24b0b29c7b7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:29.871826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0a5ea2ca-37a2-4784-92fa-a24b0b29c7b7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:29.878047 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5ea2ca-37a2-4784-92fa-a24b0b29c7b7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:29.878629 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5ea2ca-37a2-4784-92fa-a24b0b29c7b7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:29.879191 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5ea2ca-37a2-4784-92fa-a24b0b29c7b7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:29.880012 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5ea2ca-37a2-4784-92fa-a24b0b29c7b7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:29.880539 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5ea2ca-37a2-4784-92fa-a24b0b29c7b7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:29.881030 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5ea2ca-37a2-4784-92fa-a24b0b29c7b7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:29.925985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-91faca54-cf4d-4af3-910c-7c2c73d3ba16 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:29.936473 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-91faca54-cf4d-4af3-910c-7c2c73d3ba16 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1681 microversion: 2.1 time: 0.155030 Sep 13 06:44:29.937048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 337/685] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:29 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:30.019815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0a5ea2ca-37a2-4784-92fa-a24b0b29c7b7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:30.027310 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0a5ea2ca-37a2-4784-92fa-a24b0b29c7b7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.160382 Sep 13 06:44:30.027897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 349/686] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:29 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:30.959672 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-06271f82-228a-42c2-bee9-f2ffcc1c8310 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:30.960308 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-06271f82-228a-42c2-bee9-f2ffcc1c8310 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:30.966708 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06271f82-228a-42c2-bee9-f2ffcc1c8310 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:30.967192 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06271f82-228a-42c2-bee9-f2ffcc1c8310 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:30.967654 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06271f82-228a-42c2-bee9-f2ffcc1c8310 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:30.968331 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06271f82-228a-42c2-bee9-f2ffcc1c8310 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:30.968783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06271f82-228a-42c2-bee9-f2ffcc1c8310 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:30.969227 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06271f82-228a-42c2-bee9-f2ffcc1c8310 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:31.049966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3eca52e9-c730-456c-92ce-abf9da9da456 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:31.050586 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3eca52e9-c730-456c-92ce-abf9da9da456 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:31.057492 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3eca52e9-c730-456c-92ce-abf9da9da456 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:31.057979 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3eca52e9-c730-456c-92ce-abf9da9da456 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:31.058413 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3eca52e9-c730-456c-92ce-abf9da9da456 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:31.059104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3eca52e9-c730-456c-92ce-abf9da9da456 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:31.059588 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3eca52e9-c730-456c-92ce-abf9da9da456 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:31.060011 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3eca52e9-c730-456c-92ce-abf9da9da456 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:31.100783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-06271f82-228a-42c2-bee9-f2ffcc1c8310 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:31.108415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-06271f82-228a-42c2-bee9-f2ffcc1c8310 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1681 microversion: 2.1 time: 0.152540 Sep 13 06:44:31.108983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 338/687] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:30 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:31.193540 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3eca52e9-c730-456c-92ce-abf9da9da456 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:31.201575 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3eca52e9-c730-456c-92ce-abf9da9da456 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1265 microversion: 2.1 time: 0.154951 Sep 13 06:44:31.201773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 350/688] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:31 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:32.132146 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-620e5798-8ead-4ff6-b56b-7c9f583dbe39 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:32.132734 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-620e5798-8ead-4ff6-b56b-7c9f583dbe39 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:32.139023 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-620e5798-8ead-4ff6-b56b-7c9f583dbe39 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:32.139544 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-620e5798-8ead-4ff6-b56b-7c9f583dbe39 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:32.139980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-620e5798-8ead-4ff6-b56b-7c9f583dbe39 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:32.140661 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-620e5798-8ead-4ff6-b56b-7c9f583dbe39 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:32.141110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-620e5798-8ead-4ff6-b56b-7c9f583dbe39 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:32.141527 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-620e5798-8ead-4ff6-b56b-7c9f583dbe39 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:32.223174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3e79c028-5fdb-4914-910d-6807ebad6db3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:32.223811 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3e79c028-5fdb-4914-910d-6807ebad6db3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:32.230143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e79c028-5fdb-4914-910d-6807ebad6db3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:32.230620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e79c028-5fdb-4914-910d-6807ebad6db3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:32.231050 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e79c028-5fdb-4914-910d-6807ebad6db3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:32.231769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e79c028-5fdb-4914-910d-6807ebad6db3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:32.232223 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e79c028-5fdb-4914-910d-6807ebad6db3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:32.232645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3e79c028-5fdb-4914-910d-6807ebad6db3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:32.271890 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-620e5798-8ead-4ff6-b56b-7c9f583dbe39 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:32.279616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-620e5798-8ead-4ff6-b56b-7c9f583dbe39 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1681 microversion: 2.1 time: 0.151774 Sep 13 06:44:32.280192 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 339/689] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:32 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:32.368512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3e79c028-5fdb-4914-910d-6807ebad6db3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:32.376202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3e79c028-5fdb-4914-910d-6807ebad6db3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1451 microversion: 2.1 time: 0.156870 Sep 13 06:44:32.376773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 351/690] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:32 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:32.398344 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-998bad4c-aec1-41ed-ad1f-6fd919eef63c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:32.398924 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-998bad4c-aec1-41ed-ad1f-6fd919eef63c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:32.404847 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-998bad4c-aec1-41ed-ad1f-6fd919eef63c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:32.405333 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-998bad4c-aec1-41ed-ad1f-6fd919eef63c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:32.405775 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-998bad4c-aec1-41ed-ad1f-6fd919eef63c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:32.406470 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-998bad4c-aec1-41ed-ad1f-6fd919eef63c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:32.406939 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-998bad4c-aec1-41ed-ad1f-6fd919eef63c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:32.407393 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-998bad4c-aec1-41ed-ad1f-6fd919eef63c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:32.536512 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-998bad4c-aec1-41ed-ad1f-6fd919eef63c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:32.544486 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-998bad4c-aec1-41ed-ad1f-6fd919eef63c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1451 microversion: 2.1 time: 0.150024 Sep 13 06:44:32.545060 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 340/691] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:32 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:33.306614 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7f62b50b-88f7-4460-a032-ad57893a38e4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:33.308696 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7f62b50b-88f7-4460-a032-ad57893a38e4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:33.318755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f62b50b-88f7-4460-a032-ad57893a38e4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:33.319886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f62b50b-88f7-4460-a032-ad57893a38e4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:33.321607 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f62b50b-88f7-4460-a032-ad57893a38e4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:33.322777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f62b50b-88f7-4460-a032-ad57893a38e4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:33.323711 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f62b50b-88f7-4460-a032-ad57893a38e4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:33.324677 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7f62b50b-88f7-4460-a032-ad57893a38e4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:33.480702 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7f62b50b-88f7-4460-a032-ad57893a38e4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:33.489849 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7f62b50b-88f7-4460-a032-ad57893a38e4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1681 microversion: 2.1 time: 0.187926 Sep 13 06:44:33.491334 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 352/692] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:33 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:34.484498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-ff86bced-f9a4-4319-986a-aa1cdab7d30b req-e4b48e89-b99f-4d09-b66b-b2de7920763a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9177caf-8489-4764-a082-2ac3fd7c23c6", "name": "network-vif-deleted", "tag": "bdb184aa-5e29-4be4-8e1f-80f4a6c82812"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:34.494268 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=70 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:34.515967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-ff86bced-f9a4-4319-986a-aa1cdab7d30b req-e4b48e89-b99f-4d09-b66b-b2de7920763a service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:34.516648 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-ff86bced-f9a4-4319-986a-aa1cdab7d30b req-e4b48e89-b99f-4d09-b66b-b2de7920763a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:34.517626 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-ff86bced-f9a4-4319-986a-aa1cdab7d30b req-e4b48e89-b99f-4d09-b66b-b2de7920763a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:34.519187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-302246d4-6a7f-45da-ac44-7aa1ca4efc26 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:34.519866 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-302246d4-6a7f-45da-ac44-7aa1ca4efc26 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:34.526555 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:34.529473 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-302246d4-6a7f-45da-ac44-7aa1ca4efc26 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:34.529960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-302246d4-6a7f-45da-ac44-7aa1ca4efc26 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:34.530391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-302246d4-6a7f-45da-ac44-7aa1ca4efc26 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:34.531090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-302246d4-6a7f-45da-ac44-7aa1ca4efc26 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:34.531567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-302246d4-6a7f-45da-ac44-7aa1ca4efc26 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:34.532787 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-302246d4-6a7f-45da-ac44-7aa1ca4efc26 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:34.539998 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-ff86bced-f9a4-4319-986a-aa1cdab7d30b req-e4b48e89-b99f-4d09-b66b-b2de7920763a service nova] Creating event network-vif-deleted:bdb184aa-5e29-4be4-8e1f-80f4a6c82812 for instance d9177caf-8489-4764-a082-2ac3fd7c23c6 on hv-cinder-85638 Sep 13 06:44:34.554120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-ff86bced-f9a4-4319-986a-aa1cdab7d30b req-e4b48e89-b99f-4d09-b66b-b2de7920763a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079945 Sep 13 06:44:34.555110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 341/693] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:34.629258 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-302246d4-6a7f-45da-ac44-7aa1ca4efc26 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:34.644174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-302246d4-6a7f-45da-ac44-7aa1ca4efc26 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 200 len: 1326 microversion: 2.1 time: 0.134574 Sep 13 06:44:34.645445 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 353/694] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:34 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 1326 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:44:35.670775 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:35.671528 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:35.678975 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:35.679510 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:35.679977 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:35.680699 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:35.681161 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:35.681593 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:35.696286 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 HTTP/1.1 Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:44:35.697979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:44:35.699413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'd9177caf-8489-4764-a082-2ac3fd7c23c6'} Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:44:35.700167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:44:35.701518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:44:35.702653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:44:35.702653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-cff7108c-c467-4058-b2bf-8289d3d0b643 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 404 len: 111 microversion: 2.1 time: 0.033575 Sep 13 06:44:35.702653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 342/695] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:35 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:44:35.708797 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-02ef56de-e954-4d2c-8a7f-c004ef9bc044 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '.version_select at 0x7fdc0d417ee0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:35.731989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-02ef56de-e954-4d2c-8a7f-c004ef9bc044 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139874877" status: 202 len: 0 microversion: 2.1 time: 0.026969 Sep 13 06:44:35.733381 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 354/696] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Sep 13 06:44:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139874877 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:44:36.447970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1d7b1c17-b770-496f-ac13-b26457b21bb5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:36.448483 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1d7b1c17-b770-496f-ac13-b26457b21bb5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:36.454452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1d7b1c17-b770-496f-ac13-b26457b21bb5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:36.454934 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1d7b1c17-b770-496f-ac13-b26457b21bb5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:36.455389 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1d7b1c17-b770-496f-ac13-b26457b21bb5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:36.456080 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1d7b1c17-b770-496f-ac13-b26457b21bb5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:36.456535 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1d7b1c17-b770-496f-ac13-b26457b21bb5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:36.456996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1d7b1c17-b770-496f-ac13-b26457b21bb5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:36.538350 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-1d7b1c17-b770-496f-ac13-b26457b21bb5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lazy-loading 'services' on Instance uuid 1af9e76b-6689-431b-a4c2-2d681d4098ba {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:44:36.573267 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-194120b0-cdc0-4566-8c20-71ecf59f8192 req-78894f4c-73b7-4979-ac73-ed89ade0128a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6c6b92-7678-4f2d-bf4c-908373527d92", "tag": "6d8cd90d-8dbe-4213-9fee-bf02025eca4d"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:36.586520 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-194120b0-cdc0-4566-8c20-71ecf59f8192 req-78894f4c-73b7-4979-ac73-ed89ade0128a service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:36.587010 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-194120b0-cdc0-4566-8c20-71ecf59f8192 req-78894f4c-73b7-4979-ac73-ed89ade0128a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:36.587468 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-194120b0-cdc0-4566-8c20-71ecf59f8192 req-78894f4c-73b7-4979-ac73-ed89ade0128a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:36.607713 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-194120b0-cdc0-4566-8c20-71ecf59f8192 req-78894f4c-73b7-4979-ac73-ed89ade0128a service nova] Creating event network-changed:6d8cd90d-8dbe-4213-9fee-bf02025eca4d for instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 on hv-cinder-85638 Sep 13 06:44:36.613244 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1d7b1c17-b770-496f-ac13-b26457b21bb5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-volume_attachments/5bb7600d-f65e-40fd-8c41-0fec79ad2e35" status: 202 len: 0 microversion: 2.1 time: 0.168986 Sep 13 06:44:36.613386 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-194120b0-cdc0-4566-8c20-71ecf59f8192 req-78894f4c-73b7-4979-ac73-ed89ade0128a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045398 Sep 13 06:44:36.614008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 343/698] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:44:36 2022] DELETE /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-volume_attachments/5bb7600d-f65e-40fd-8c41-0fec79ad2e35 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:44:36.614147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 355/698] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:44:36.622644 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-eb733675-53b7-461d-8c27-466a78be582c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:36.624860 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-eb733675-53b7-461d-8c27-466a78be582c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:36.631478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb733675-53b7-461d-8c27-466a78be582c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:36.631966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb733675-53b7-461d-8c27-466a78be582c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:36.632400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb733675-53b7-461d-8c27-466a78be582c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:36.633085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb733675-53b7-461d-8c27-466a78be582c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:36.633694 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb733675-53b7-461d-8c27-466a78be582c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:36.634118 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-eb733675-53b7-461d-8c27-466a78be582c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:36.663187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-eb733675-53b7-461d-8c27-466a78be582c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Sep 13 06:44:36.664019 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 356/699] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:44:36 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:44:37.677465 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-99824d30-2e7f-49c7-bd6f-104daf5cf107 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:37.679768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-99824d30-2e7f-49c7-bd6f-104daf5cf107 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:37.685759 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99824d30-2e7f-49c7-bd6f-104daf5cf107 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:37.686245 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99824d30-2e7f-49c7-bd6f-104daf5cf107 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:37.686717 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99824d30-2e7f-49c7-bd6f-104daf5cf107 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:37.687629 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99824d30-2e7f-49c7-bd6f-104daf5cf107 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:37.688083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99824d30-2e7f-49c7-bd6f-104daf5cf107 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:37.688569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-99824d30-2e7f-49c7-bd6f-104daf5cf107 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:37.714658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:37.720169 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-99824d30-2e7f-49c7-bd6f-104daf5cf107 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047952 Sep 13 06:44:37.720746 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 344/700] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:44:37 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:38.732581 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-11985077-ca75-4158-9578-00850d8fb7cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:38.734628 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-11985077-ca75-4158-9578-00850d8fb7cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:38.741776 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11985077-ca75-4158-9578-00850d8fb7cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:38.742213 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11985077-ca75-4158-9578-00850d8fb7cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:38.742647 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11985077-ca75-4158-9578-00850d8fb7cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:38.743328 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11985077-ca75-4158-9578-00850d8fb7cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:38.743811 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11985077-ca75-4158-9578-00850d8fb7cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:38.744229 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-11985077-ca75-4158-9578-00850d8fb7cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:38.771795 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-11985077-ca75-4158-9578-00850d8fb7cd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043142 Sep 13 06:44:38.772338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 357/701] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:44:38 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 06:44:38.836658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ba104141-b301-407c-a2a4-ef0eee2eb000 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:38.837153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ba104141-b301-407c-a2a4-ef0eee2eb000 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:38.843711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba104141-b301-407c-a2a4-ef0eee2eb000 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:38.844189 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba104141-b301-407c-a2a4-ef0eee2eb000 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:38.844621 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba104141-b301-407c-a2a4-ef0eee2eb000 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:38.845300 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba104141-b301-407c-a2a4-ef0eee2eb000 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:38.845753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba104141-b301-407c-a2a4-ef0eee2eb000 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:38.846170 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ba104141-b301-407c-a2a4-ef0eee2eb000 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:38.871298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ba104141-b301-407c-a2a4-ef0eee2eb000 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Going to try to terminate instance {{(pid=132398) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:44:38.953709 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ba104141-b301-407c-a2a4-ef0eee2eb000 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 204 len: 0 microversion: 2.1 time: 0.121397 Sep 13 06:44:38.954294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 345/702] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:44:38 2022] DELETE /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:44:38.962279 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1d3842c2-fda6-4023-b2a6-5a3718f8bf49 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:38.962884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1d3842c2-fda6-4023-b2a6-5a3718f8bf49 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:38.968664 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1d3842c2-fda6-4023-b2a6-5a3718f8bf49 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:38.969146 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1d3842c2-fda6-4023-b2a6-5a3718f8bf49 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:38.969573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1d3842c2-fda6-4023-b2a6-5a3718f8bf49 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:38.970255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1d3842c2-fda6-4023-b2a6-5a3718f8bf49 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:38.970704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1d3842c2-fda6-4023-b2a6-5a3718f8bf49 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:38.971121 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1d3842c2-fda6-4023-b2a6-5a3718f8bf49 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:39.102582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1d3842c2-fda6-4023-b2a6-5a3718f8bf49 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:39.110644 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1d3842c2-fda6-4023-b2a6-5a3718f8bf49 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1682 microversion: 2.1 time: 0.151980 Sep 13 06:44:39.111278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 358/703] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:38 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:40.135296 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-08a0f355-3251-4f0f-bfa3-fb1595ae7f50 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:40.136024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-08a0f355-3251-4f0f-bfa3-fb1595ae7f50 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:40.142328 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-08a0f355-3251-4f0f-bfa3-fb1595ae7f50 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:40.142812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-08a0f355-3251-4f0f-bfa3-fb1595ae7f50 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:40.143247 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-08a0f355-3251-4f0f-bfa3-fb1595ae7f50 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:40.143972 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-08a0f355-3251-4f0f-bfa3-fb1595ae7f50 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:40.144436 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-08a0f355-3251-4f0f-bfa3-fb1595ae7f50 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:40.144864 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-08a0f355-3251-4f0f-bfa3-fb1595ae7f50 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:40.373351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-08a0f355-3251-4f0f-bfa3-fb1595ae7f50 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:40.381464 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-08a0f355-3251-4f0f-bfa3-fb1595ae7f50 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1682 microversion: 2.1 time: 0.250504 Sep 13 06:44:40.382029 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 346/704] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:40 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:41.021105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-e25d7411-18a3-4fe4-b810-25b9b508461a req-516788c4-eb73-48fa-9390-ee66a893a891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af9e76b-6689-431b-a4c2-2d681d4098ba", "name": "network-vif-deleted", "tag": "3c3acc09-6c0d-4f36-8f12-849b52e0123f"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:41.032915 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-e25d7411-18a3-4fe4-b810-25b9b508461a req-516788c4-eb73-48fa-9390-ee66a893a891 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:41.033427 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-e25d7411-18a3-4fe4-b810-25b9b508461a req-516788c4-eb73-48fa-9390-ee66a893a891 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:41.033992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-e25d7411-18a3-4fe4-b810-25b9b508461a req-516788c4-eb73-48fa-9390-ee66a893a891 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:41.059627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-e25d7411-18a3-4fe4-b810-25b9b508461a req-516788c4-eb73-48fa-9390-ee66a893a891 service nova] Creating event network-vif-deleted:3c3acc09-6c0d-4f36-8f12-849b52e0123f for instance 1af9e76b-6689-431b-a4c2-2d681d4098ba on hv-cinder-85638 Sep 13 06:44:41.065019 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-e25d7411-18a3-4fe4-b810-25b9b508461a req-516788c4-eb73-48fa-9390-ee66a893a891 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048490 Sep 13 06:44:41.065657 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 359/705] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:41.404365 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:41.405218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:41.413038 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:41.414064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:41.414684 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:41.415552 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:41.416077 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:41.416567 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:41.451571 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:41.452162 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:41.452835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:41.453615 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lazy-loading 'fault' on Instance uuid 1af9e76b-6689-431b-a4c2-2d681d4098ba {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:44:41.500527 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:41.508173 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1daf2da3-52cb-4740-b80b-86314bf53112 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 200 len: 1332 microversion: 2.1 time: 0.107902 Sep 13 06:44:41.508743 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 347/706] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:41 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:42.533409 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:42.534174 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:42.541252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:42.541737 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:42.542176 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:42.542861 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:42.543313 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:42.543759 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:42.557356 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba HTTP/1.1 Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:44:42.558970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:44:42.560506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '1af9e76b-6689-431b-a4c2-2d681d4098ba'} Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:44:42.561400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:44:42.562708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:44:42.563896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:44:42.563896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-82aea9e4-12a4-45d7-9825-0febb63669d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 404 len: 111 microversion: 2.1 time: 0.031883 Sep 13 06:44:42.563896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 360/707] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:42 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:44:42.569113 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6e0a9c92-0d43-42ec-8268-a595aeca7d8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '.version_select at 0x7fdc0d490790>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:42.594231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6e0a9c92-0d43-42ec-8268-a595aeca7d8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883974686" status: 202 len: 0 microversion: 2.1 time: 0.028835 Sep 13 06:44:42.594806 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 348/708] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Sep 13 06:44:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883974686 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:44:43.216330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7c9b7e8a-2796-43b1-8e78-5666041b0f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: .version_select at 0x7fdc0d4874c0>, body: {"keypair": {"name": "tempest-keypair-1970454711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpk2SaBsk4AZ0sP7R5pK8OOb7qJBxmm08JV0dxbqSETtLLz38Rh1whZdrfVgXBA2xSkaWFQXamRMQRM9GHT/GIacESIfx2wIjh5iwSGsK99eEfDsKAEdD357i7/DKD/tQ=="}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:43.231761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-7c9b7e8a-2796-43b1-8e78-5666041b0f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:44:43.235597 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-7c9b7e8a-2796-43b1-8e78-5666041b0f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for user cac2d22d853a4984b229911bde3a450b and project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:44:43.256870 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7c9b7e8a-2796-43b1-8e78-5666041b0f06 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044447 Sep 13 06:44:43.257454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 361/709] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Sep 13 06:44:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:44.500891 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2075756102", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "490d7309-ad3e-4bc6-9625-e6996e2b80d7"}], "security_groups": [{"name": "tempest-securitygroup--2026337321"}], "key_name": "tempest-keypair-1970454711", "user_data": "}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:44.604358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] validate_networks() for [('490d7309-ad3e-4bc6-9625-e6996e2b80d7', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:44:45.059058 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:44:45.059549 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:44:45.060022 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:44:45.060433 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:44:45.060845 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:44:45.070172 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:45.070653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:45.071088 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:45.071855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:45.072331 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:45.072758 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:45.089664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:44:45.093524 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for user cac2d22d853a4984b229911bde3a450b and project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:44:45.104454 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:44:45.106702 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:44:45.154197 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ad605cc4-9530-4c78-b3a1-d3401b769caf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.658185 Sep 13 06:44:45.154846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 349/710] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:44:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:44:45.167302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b06cdeee-2c6e-410b-84da-db2c26da7c52 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:45.167944 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b06cdeee-2c6e-410b-84da-db2c26da7c52 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:45.223910 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b06cdeee-2c6e-410b-84da-db2c26da7c52 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:45.230572 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b06cdeee-2c6e-410b-84da-db2c26da7c52 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1242 microversion: 2.1 time: 0.068566 Sep 13 06:44:45.231111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 362/711] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:45 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:46.254130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c910279b-950c-4a50-9aff-fc1cabb12bb3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:46.254736 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c910279b-950c-4a50-9aff-fc1cabb12bb3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:46.261415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c910279b-950c-4a50-9aff-fc1cabb12bb3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:46.261924 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c910279b-950c-4a50-9aff-fc1cabb12bb3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:46.262354 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c910279b-950c-4a50-9aff-fc1cabb12bb3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:46.263038 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c910279b-950c-4a50-9aff-fc1cabb12bb3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:46.263529 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c910279b-950c-4a50-9aff-fc1cabb12bb3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:46.263951 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c910279b-950c-4a50-9aff-fc1cabb12bb3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:46.326368 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c910279b-950c-4a50-9aff-fc1cabb12bb3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:46.334611 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c910279b-950c-4a50-9aff-fc1cabb12bb3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1294 microversion: 2.1 time: 0.085046 Sep 13 06:44:46.335171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 350/712] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:46 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:47.356755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8ad770b8-e459-4f83-8d8f-1fbd1347f2a8 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:47.357360 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8ad770b8-e459-4f83-8d8f-1fbd1347f2a8 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:47.363962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ad770b8-e459-4f83-8d8f-1fbd1347f2a8 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:47.364447 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ad770b8-e459-4f83-8d8f-1fbd1347f2a8 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:47.364871 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ad770b8-e459-4f83-8d8f-1fbd1347f2a8 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:47.365571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ad770b8-e459-4f83-8d8f-1fbd1347f2a8 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:47.366020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ad770b8-e459-4f83-8d8f-1fbd1347f2a8 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:47.366435 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8ad770b8-e459-4f83-8d8f-1fbd1347f2a8 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:47.520143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8ad770b8-e459-4f83-8d8f-1fbd1347f2a8 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:47.527825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8ad770b8-e459-4f83-8d8f-1fbd1347f2a8 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1368 microversion: 2.1 time: 0.175067 Sep 13 06:44:47.528392 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 363/713] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:47 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:47.996947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-41797616-247b-4e5c-ac51-4fbca64971f3 req-9202df7a-9bf1-4a21-85d5-c32e37ea9b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4531b7bb-f851-4652-8ae1-c60a44937f2a", "tag": "43b1e076-8ca9-454c-9682-8fbb81d23f05"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:48.008590 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-41797616-247b-4e5c-ac51-4fbca64971f3 req-9202df7a-9bf1-4a21-85d5-c32e37ea9b85 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:48.009499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-41797616-247b-4e5c-ac51-4fbca64971f3 req-9202df7a-9bf1-4a21-85d5-c32e37ea9b85 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:48.010212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-41797616-247b-4e5c-ac51-4fbca64971f3 req-9202df7a-9bf1-4a21-85d5-c32e37ea9b85 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:48.023398 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-41797616-247b-4e5c-ac51-4fbca64971f3 req-9202df7a-9bf1-4a21-85d5-c32e37ea9b85 service nova] Creating event network-changed:43b1e076-8ca9-454c-9682-8fbb81d23f05 for instance 4531b7bb-f851-4652-8ae1-c60a44937f2a on hv-cinder-85638 Sep 13 06:44:48.028404 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-41797616-247b-4e5c-ac51-4fbca64971f3 req-9202df7a-9bf1-4a21-85d5-c32e37ea9b85 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035003 Sep 13 06:44:48.029339 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 351/714] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:48.551711 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-70b0c444-c41d-4818-a858-229aed7549e7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:48.552252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-70b0c444-c41d-4818-a858-229aed7549e7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:48.558529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70b0c444-c41d-4818-a858-229aed7549e7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:48.559006 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70b0c444-c41d-4818-a858-229aed7549e7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:48.559455 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70b0c444-c41d-4818-a858-229aed7549e7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:48.560137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70b0c444-c41d-4818-a858-229aed7549e7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:48.560583 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70b0c444-c41d-4818-a858-229aed7549e7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:48.560997 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70b0c444-c41d-4818-a858-229aed7549e7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:48.691597 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-70b0c444-c41d-4818-a858-229aed7549e7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:48.699038 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-70b0c444-c41d-4818-a858-229aed7549e7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1368 microversion: 2.1 time: 0.151348 Sep 13 06:44:48.699627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 364/715] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:48 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:49.723401 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7c48c151-fbeb-4cb5-8fc3-8f8102212e1d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:49.724095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7c48c151-fbeb-4cb5-8fc3-8f8102212e1d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:49.730116 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7c48c151-fbeb-4cb5-8fc3-8f8102212e1d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:49.730594 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7c48c151-fbeb-4cb5-8fc3-8f8102212e1d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:49.731026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7c48c151-fbeb-4cb5-8fc3-8f8102212e1d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:49.731729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7c48c151-fbeb-4cb5-8fc3-8f8102212e1d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:49.732183 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7c48c151-fbeb-4cb5-8fc3-8f8102212e1d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:49.732603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7c48c151-fbeb-4cb5-8fc3-8f8102212e1d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:49.858177 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7c48c151-fbeb-4cb5-8fc3-8f8102212e1d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:49.865820 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7c48c151-fbeb-4cb5-8fc3-8f8102212e1d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1368 microversion: 2.1 time: 0.147859 Sep 13 06:44:49.870731 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 352/716] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:49 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:50.888533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-46f76130-ef20-4c3e-990c-9b1562c0bf62 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:50.889077 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-46f76130-ef20-4c3e-990c-9b1562c0bf62 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:50.895315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-46f76130-ef20-4c3e-990c-9b1562c0bf62 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:50.895815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-46f76130-ef20-4c3e-990c-9b1562c0bf62 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:50.896240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-46f76130-ef20-4c3e-990c-9b1562c0bf62 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:50.896915 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-46f76130-ef20-4c3e-990c-9b1562c0bf62 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:50.897361 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-46f76130-ef20-4c3e-990c-9b1562c0bf62 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:50.897778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-46f76130-ef20-4c3e-990c-9b1562c0bf62 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:51.029729 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-46f76130-ef20-4c3e-990c-9b1562c0bf62 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:51.037880 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-46f76130-ef20-4c3e-990c-9b1562c0bf62 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1368 microversion: 2.1 time: 0.153223 Sep 13 06:44:51.038434 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 365/717] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:50 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:52.061548 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-29327959-7a0a-4b34-811f-4367dd6d9721 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:52.062090 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-29327959-7a0a-4b34-811f-4367dd6d9721 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:52.069056 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29327959-7a0a-4b34-811f-4367dd6d9721 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:52.069543 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29327959-7a0a-4b34-811f-4367dd6d9721 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:52.069976 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29327959-7a0a-4b34-811f-4367dd6d9721 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:52.070668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29327959-7a0a-4b34-811f-4367dd6d9721 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:52.071123 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29327959-7a0a-4b34-811f-4367dd6d9721 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:52.071577 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-29327959-7a0a-4b34-811f-4367dd6d9721 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:52.201852 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-29327959-7a0a-4b34-811f-4367dd6d9721 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:52.209338 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-29327959-7a0a-4b34-811f-4367dd6d9721 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1368 microversion: 2.1 time: 0.151823 Sep 13 06:44:52.209900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 353/718] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:52 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:52.490663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-17cfc75f-ff62-4d85-8b60-74bb4ee3bed7 req-7d4c9763-a17e-45e5-bd8d-cafb2f27d6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4531b7bb-f851-4652-8ae1-c60a44937f2a", "name": "network-vif-plugged", "status": "completed", "tag": "43b1e076-8ca9-454c-9682-8fbb81d23f05"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:52.500891 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-17cfc75f-ff62-4d85-8b60-74bb4ee3bed7 req-7d4c9763-a17e-45e5-bd8d-cafb2f27d6ea service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:52.501390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-17cfc75f-ff62-4d85-8b60-74bb4ee3bed7 req-7d4c9763-a17e-45e5-bd8d-cafb2f27d6ea service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:52.501818 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-17cfc75f-ff62-4d85-8b60-74bb4ee3bed7 req-7d4c9763-a17e-45e5-bd8d-cafb2f27d6ea service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:52.513340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-17cfc75f-ff62-4d85-8b60-74bb4ee3bed7 req-7d4c9763-a17e-45e5-bd8d-cafb2f27d6ea service nova] Creating event network-vif-plugged:43b1e076-8ca9-454c-9682-8fbb81d23f05 for instance 4531b7bb-f851-4652-8ae1-c60a44937f2a on hv-cinder-85638 Sep 13 06:44:52.518173 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-17cfc75f-ff62-4d85-8b60-74bb4ee3bed7 req-7d4c9763-a17e-45e5-bd8d-cafb2f27d6ea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031304 Sep 13 06:44:52.519298 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 366/719] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:44:53.232126 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a6bc70e1-60c6-40b3-a8f3-756bec1126ed tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:53.232730 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a6bc70e1-60c6-40b3-a8f3-756bec1126ed tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:53.239831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6bc70e1-60c6-40b3-a8f3-756bec1126ed tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:53.240307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6bc70e1-60c6-40b3-a8f3-756bec1126ed tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:53.240739 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6bc70e1-60c6-40b3-a8f3-756bec1126ed tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:53.241420 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6bc70e1-60c6-40b3-a8f3-756bec1126ed tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:53.241864 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6bc70e1-60c6-40b3-a8f3-756bec1126ed tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:53.242282 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a6bc70e1-60c6-40b3-a8f3-756bec1126ed tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:53.368848 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a6bc70e1-60c6-40b3-a8f3-756bec1126ed tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:53.376507 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a6bc70e1-60c6-40b3-a8f3-756bec1126ed tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1368 microversion: 2.1 time: 0.148136 Sep 13 06:44:53.377075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 354/720] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:53 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:54.400189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bc10ac90-4a32-40fe-839d-ed3d1e1c3b20 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:54.400907 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-bc10ac90-4a32-40fe-839d-ed3d1e1c3b20 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:54.407048 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bc10ac90-4a32-40fe-839d-ed3d1e1c3b20 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:54.407563 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bc10ac90-4a32-40fe-839d-ed3d1e1c3b20 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:54.407996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bc10ac90-4a32-40fe-839d-ed3d1e1c3b20 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:54.408677 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bc10ac90-4a32-40fe-839d-ed3d1e1c3b20 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:54.409130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bc10ac90-4a32-40fe-839d-ed3d1e1c3b20 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:54.409565 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bc10ac90-4a32-40fe-839d-ed3d1e1c3b20 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:54.546006 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-bc10ac90-4a32-40fe-839d-ed3d1e1c3b20 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:54.554099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-bc10ac90-4a32-40fe-839d-ed3d1e1c3b20 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1368 microversion: 2.1 time: 0.158665 Sep 13 06:44:54.554664 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 367/721] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:54 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:55.576611 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ff6af51c-15c3-4d3d-a544-0aa467c8839b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:55.577220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ff6af51c-15c3-4d3d-a544-0aa467c8839b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:55.579639 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:55.580415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=6 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:55.586360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6af51c-15c3-4d3d-a544-0aa467c8839b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:55.586479 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6af51c-15c3-4d3d-a544-0aa467c8839b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:55.586817 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6af51c-15c3-4d3d-a544-0aa467c8839b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:55.587549 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6af51c-15c3-4d3d-a544-0aa467c8839b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:55.588004 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6af51c-15c3-4d3d-a544-0aa467c8839b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:55.588431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff6af51c-15c3-4d3d-a544-0aa467c8839b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:55.716278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ff6af51c-15c3-4d3d-a544-0aa467c8839b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:44:55.723891 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ff6af51c-15c3-4d3d-a544-0aa467c8839b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1559 microversion: 2.1 time: 0.151209 Sep 13 06:44:55.724464 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 355/722] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:44:55 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:44:55.746687 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e703bfaa-9ac4-4fe9-8112-d777c29c9f4d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:44:55.747202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e703bfaa-9ac4-4fe9-8112-d777c29c9f4d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:44:55.749338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=6 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:55.755153 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e703bfaa-9ac4-4fe9-8112-d777c29c9f4d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:55.755661 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e703bfaa-9ac4-4fe9-8112-d777c29c9f4d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:55.756125 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e703bfaa-9ac4-4fe9-8112-d777c29c9f4d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:55.756807 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e703bfaa-9ac4-4fe9-8112-d777c29c9f4d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:55.757255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e703bfaa-9ac4-4fe9-8112-d777c29c9f4d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:55.757671 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e703bfaa-9ac4-4fe9-8112-d777c29c9f4d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:55.832668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e703bfaa-9ac4-4fe9-8112-d777c29c9f4d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089773 Sep 13 06:44:55.833257 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 368/723] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Sep 13 06:44:55 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:44:56.997494 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-1ef21de4-b74d-40ae-a0f4-13380cd27fe3 req-3e02010e-2b02-46a7-84d5-ba47179ef3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4531b7bb-f851-4652-8ae1-c60a44937f2a", "tag": "43b1e076-8ca9-454c-9682-8fbb81d23f05"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:44:57.007169 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-1ef21de4-b74d-40ae-a0f4-13380cd27fe3 req-3e02010e-2b02-46a7-84d5-ba47179ef3b7 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:44:57.007701 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-1ef21de4-b74d-40ae-a0f4-13380cd27fe3 req-3e02010e-2b02-46a7-84d5-ba47179ef3b7 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:44:57.008126 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-1ef21de4-b74d-40ae-a0f4-13380cd27fe3 req-3e02010e-2b02-46a7-84d5-ba47179ef3b7 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:44:57.018989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-1ef21de4-b74d-40ae-a0f4-13380cd27fe3 req-3e02010e-2b02-46a7-84d5-ba47179ef3b7 service nova] Creating event network-changed:43b1e076-8ca9-454c-9682-8fbb81d23f05 for instance 4531b7bb-f851-4652-8ae1-c60a44937f2a on hv-cinder-85638 Sep 13 06:44:57.023855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-1ef21de4-b74d-40ae-a0f4-13380cd27fe3 req-3e02010e-2b02-46a7-84d5-ba47179ef3b7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088855 Sep 13 06:44:57.024441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 356/724] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:07.388874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:07.389690 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:07.394530 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fa992bfd-12ef-4218-a1c5-41afbf16bd9e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:07.396658 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-fa992bfd-12ef-4218-a1c5-41afbf16bd9e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:07.404162 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fa992bfd-12ef-4218-a1c5-41afbf16bd9e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:07.404711 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fa992bfd-12ef-4218-a1c5-41afbf16bd9e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:07.405198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fa992bfd-12ef-4218-a1c5-41afbf16bd9e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:07.405882 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fa992bfd-12ef-4218-a1c5-41afbf16bd9e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:07.406335 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fa992bfd-12ef-4218-a1c5-41afbf16bd9e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:07.406755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fa992bfd-12ef-4218-a1c5-41afbf16bd9e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:07.437265 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fa992bfd-12ef-4218-a1c5-41afbf16bd9e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049683 Sep 13 06:45:07.437808 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 369/725] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:45:07 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 06:45:07.502446 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-45b9d491-7861-4831-8b21-f1678186715b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:07.503026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-45b9d491-7861-4831-8b21-f1678186715b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:07.505604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:07.506239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:07.511975 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-45b9d491-7861-4831-8b21-f1678186715b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:07.512453 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-45b9d491-7861-4831-8b21-f1678186715b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:07.512886 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-45b9d491-7861-4831-8b21-f1678186715b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:07.513567 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-45b9d491-7861-4831-8b21-f1678186715b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:07.514020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-45b9d491-7861-4831-8b21-f1678186715b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:07.514439 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-45b9d491-7861-4831-8b21-f1678186715b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:07.542489 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-45b9d491-7861-4831-8b21-f1678186715b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Going to try to terminate instance {{(pid=132398) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:45:07.618414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-45b9d491-7861-4831-8b21-f1678186715b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 204 len: 0 microversion: 2.1 time: 0.119854 Sep 13 06:45:07.619229 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 357/726] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:45:07 2022] DELETE /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:45:07.628237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-80e92cdc-7d75-40fd-9840-20cac054d561 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:07.628846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-80e92cdc-7d75-40fd-9840-20cac054d561 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:07.634685 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80e92cdc-7d75-40fd-9840-20cac054d561 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:07.635166 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80e92cdc-7d75-40fd-9840-20cac054d561 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:07.635637 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80e92cdc-7d75-40fd-9840-20cac054d561 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:07.636321 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80e92cdc-7d75-40fd-9840-20cac054d561 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:07.636774 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80e92cdc-7d75-40fd-9840-20cac054d561 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:07.637353 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-80e92cdc-7d75-40fd-9840-20cac054d561 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:07.763115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-80e92cdc-7d75-40fd-9840-20cac054d561 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:07.770725 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-80e92cdc-7d75-40fd-9840-20cac054d561 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1673 microversion: 2.1 time: 0.146826 Sep 13 06:45:07.771286 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 370/727] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:07 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:08.794885 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-98a5e1da-ad7e-4330-9e61-afc85b3c5fa9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:08.795627 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-98a5e1da-ad7e-4330-9e61-afc85b3c5fa9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:08.802384 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-98a5e1da-ad7e-4330-9e61-afc85b3c5fa9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:08.802864 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-98a5e1da-ad7e-4330-9e61-afc85b3c5fa9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:08.803299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-98a5e1da-ad7e-4330-9e61-afc85b3c5fa9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:08.804006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-98a5e1da-ad7e-4330-9e61-afc85b3c5fa9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:08.804460 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-98a5e1da-ad7e-4330-9e61-afc85b3c5fa9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:08.804880 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-98a5e1da-ad7e-4330-9e61-afc85b3c5fa9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:08.933667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-98a5e1da-ad7e-4330-9e61-afc85b3c5fa9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:08.941943 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-98a5e1da-ad7e-4330-9e61-afc85b3c5fa9 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1673 microversion: 2.1 time: 0.151267 Sep 13 06:45:08.942502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 358/728] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:08 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:09.966026 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b26c8525-6b83-44ac-b620-6b143cd850a4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:09.966747 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b26c8525-6b83-44ac-b620-6b143cd850a4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:09.973327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b26c8525-6b83-44ac-b620-6b143cd850a4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:09.973894 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b26c8525-6b83-44ac-b620-6b143cd850a4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:09.974340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b26c8525-6b83-44ac-b620-6b143cd850a4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:09.975039 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b26c8525-6b83-44ac-b620-6b143cd850a4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:09.975534 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b26c8525-6b83-44ac-b620-6b143cd850a4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:09.975963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b26c8525-6b83-44ac-b620-6b143cd850a4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:10.106990 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b26c8525-6b83-44ac-b620-6b143cd850a4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:10.114724 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b26c8525-6b83-44ac-b620-6b143cd850a4 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1673 microversion: 2.1 time: 0.152556 Sep 13 06:45:10.115294 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 371/729] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:09 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:10.501212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-7b4d15c9-0b0c-4cd5-a161-f40534321745 req-e157eb2f-d35d-4347-9094-ad7ab16064f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e145800-524d-4430-b95f-aff5b2719b66", "name": "network-vif-deleted", "tag": "f7108ccd-a719-43b7-9171-8b580de3d99d"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:10.512616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-7b4d15c9-0b0c-4cd5-a161-f40534321745 req-e157eb2f-d35d-4347-9094-ad7ab16064f4 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:10.513106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-7b4d15c9-0b0c-4cd5-a161-f40534321745 req-e157eb2f-d35d-4347-9094-ad7ab16064f4 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:10.513542 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-7b4d15c9-0b0c-4cd5-a161-f40534321745 req-e157eb2f-d35d-4347-9094-ad7ab16064f4 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:10.524640 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-7b4d15c9-0b0c-4cd5-a161-f40534321745 req-e157eb2f-d35d-4347-9094-ad7ab16064f4 service nova] Creating event network-vif-deleted:f7108ccd-a719-43b7-9171-8b580de3d99d for instance 4e145800-524d-4430-b95f-aff5b2719b66 on hv-cinder-85638 Sep 13 06:45:10.529697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-7b4d15c9-0b0c-4cd5-a161-f40534321745 req-e157eb2f-d35d-4347-9094-ad7ab16064f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032312 Sep 13 06:45:10.530653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 359/730] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:11.142051 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:11.142685 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:11.149506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:11.149992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:11.150425 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:11.151113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:11.151597 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:11.152018 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:11.184470 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:11.184981 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:11.185423 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:11.185935 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.objects.instance [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lazy-loading 'fault' on Instance uuid 4e145800-524d-4430-b95f-aff5b2719b66 {{(pid=132399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:45:11.234240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:11.243887 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f0bbf16f-0509-4e86-a51f-dacadfda81b7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 200 len: 1326 microversion: 2.1 time: 0.105587 Sep 13 06:45:11.244465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 372/731] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:11 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:12.268050 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:12.268743 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:12.274745 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:12.275220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:12.275683 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:12.276365 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:12.276816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:12.277233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:12.292929 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] HTTP exception thrown: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Request method failure captured: Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 HTTP/1.1 Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUq7ZR7NnSJM6Q51gWE3W5BdgHfXarWcdRmC9CkOEZupdLGEyEY8Tm3qtbsmzMKlAMf1YEJdnnKZ_DTtw0lqGgDXyFDRce9uI00yNcBT4bzkOsdT_DtwHWRl2pJWANYEuRyWYQfGlWSWO-QEFxQkCwr1_krr3_HnIr0OXMYfq5Cqzs Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:45:12.294503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: a8b45d538d6e4749b3997d5e6845dfe5 Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:45:12.296094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '4e145800-524d-4430-b95f-aff5b2719b66'} Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:45:12.297095 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:45:12.298568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:45:12.300582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Returning 404 to user: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:45:12.300582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-60954708-7d3f-4c8b-bfd0-f8b723d301cb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 404 len: 111 microversion: 2.1 time: 0.032591 Sep 13 06:45:12.300582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 360/732] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:12 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:45:12.305209 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8425435f-3ea7-49be-9cba-cc1f791d6549 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '.version_select at 0x7fdc0d4099d0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:12.322868 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8425435f-3ea7-49be-9cba-cc1f791d6549 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-737027912" status: 202 len: 0 microversion: 2.1 time: 0.021443 Sep 13 06:45:12.323441 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 373/733] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Sep 13 06:45:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-737027912 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:45:12.936792 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f35edf04-3988-4f2e-977d-d1f99867410c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'create', calling method: .version_select at 0x7fdc0d548f70>, body: {"keypair": {"name": "tempest-keypair-1110026259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITQgH9WVRFntflLXc0sRIbLcx9/7wG+ypJ5wxJj2fDYwaFCVFC2eXXB+S7g2wTfL5rKCBz4IBXT8gCxp1M53kT5lSZddFSoV7wcVQjZxoPMohMeUROgoaShddijH6F3WA=="}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:12.952187 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-f35edf04-3988-4f2e-977d-d1f99867410c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Getting quotas for project 2645e663e8564c0bb7e0da327a6019bf. Resources: {'key_pairs'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:45:12.956702 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-f35edf04-3988-4f2e-977d-d1f99867410c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Getting quotas for user a8b45d538d6e4749b3997d5e6845dfe5 and project 2645e663e8564c0bb7e0da327a6019bf. Resources: {'key_pairs'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:45:12.977810 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f35edf04-3988-4f2e-977d-d1f99867410c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044930 Sep 13 06:45:12.978385 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 361/734] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Sep 13 06:45:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:14.234687 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1107985042", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "499735c8-cc2d-4c3c-abac-f686f30e040d"}], "security_groups": [{"name": "tempest-securitygroup--598690026"}], "key_name": "tempest-keypair-1110026259", "user_data": "}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:14.341274 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.network.neutron [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] validate_networks() for [('499735c8-cc2d-4c3c-abac-f686f30e040d', None, None, None, None, None)] {{(pid=132399) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:45:14.718814 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Flavor limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:45:14.719233 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Image limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:45:14.719740 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Flavor pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:45:14.720143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Image pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:45:14.720549 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:45:14.729145 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:14.729622 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:14.730056 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:14.730777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:14.731229 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:14.731685 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:14.749412 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Getting quotas for project 2645e663e8564c0bb7e0da327a6019bf. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:45:14.754400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Getting quotas for user a8b45d538d6e4749b3997d5e6845dfe5 and project 2645e663e8564c0bb7e0da327a6019bf. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:45:14.765388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Going to run 1 instances... {{(pid=132399) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:45:14.767748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:45:14.817081 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f4b12304-6636-4c49-aa75-35cea340a88b tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.587079 Sep 13 06:45:14.817724 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 374/735] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:45:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:45:14.829074 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e8a33ab6-2997-407f-8ebc-cf0848de218c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:14.829677 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e8a33ab6-2997-407f-8ebc-cf0848de218c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:14.890945 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e8a33ab6-2997-407f-8ebc-cf0848de218c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:14.897855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e8a33ab6-2997-407f-8ebc-cf0848de218c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1238 microversion: 2.1 time: 0.073014 Sep 13 06:45:14.898419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 362/736] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:14 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:15.920938 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3967159b-e0e6-4917-ada6-ca7478926a59 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:15.921544 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3967159b-e0e6-4917-ada6-ca7478926a59 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:15.929098 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3967159b-e0e6-4917-ada6-ca7478926a59 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:15.929439 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3967159b-e0e6-4917-ada6-ca7478926a59 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:15.930228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3967159b-e0e6-4917-ada6-ca7478926a59 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:15.930812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3967159b-e0e6-4917-ada6-ca7478926a59 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:15.931262 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3967159b-e0e6-4917-ada6-ca7478926a59 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:15.931800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3967159b-e0e6-4917-ada6-ca7478926a59 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:15.997459 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3967159b-e0e6-4917-ada6-ca7478926a59 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:16.005312 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3967159b-e0e6-4917-ada6-ca7478926a59 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1290 microversion: 2.1 time: 0.088424 Sep 13 06:45:16.005867 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 375/737] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:15 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:17.028349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-767e9445-7dd7-499d-9f2d-1622e8a7e2a2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:17.028965 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-767e9445-7dd7-499d-9f2d-1622e8a7e2a2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:17.035319 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-767e9445-7dd7-499d-9f2d-1622e8a7e2a2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:17.035844 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-767e9445-7dd7-499d-9f2d-1622e8a7e2a2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:17.036290 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-767e9445-7dd7-499d-9f2d-1622e8a7e2a2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:17.036988 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-767e9445-7dd7-499d-9f2d-1622e8a7e2a2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:17.037445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-767e9445-7dd7-499d-9f2d-1622e8a7e2a2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:17.037876 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-767e9445-7dd7-499d-9f2d-1622e8a7e2a2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:17.293015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-767e9445-7dd7-499d-9f2d-1622e8a7e2a2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:17.301130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-767e9445-7dd7-499d-9f2d-1622e8a7e2a2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1363 microversion: 2.1 time: 0.276609 Sep 13 06:45:17.301703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 363/738] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:17 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:17.678777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-7eb6e749-1a9d-4613-a54b-9f9a4378ae58 req-30439b7a-20d5-4760-b284-a0fc60ecb7ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b94d975-3eb2-4a82-bafe-c0b5a442f122", "tag": "c9330f0b-a90e-45e8-ab95-6401cdf4237e"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:17.689117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-7eb6e749-1a9d-4613-a54b-9f9a4378ae58 req-30439b7a-20d5-4760-b284-a0fc60ecb7ca service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:17.690760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-7eb6e749-1a9d-4613-a54b-9f9a4378ae58 req-30439b7a-20d5-4760-b284-a0fc60ecb7ca service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:17.691188 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-7eb6e749-1a9d-4613-a54b-9f9a4378ae58 req-30439b7a-20d5-4760-b284-a0fc60ecb7ca service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:17.702207 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-7eb6e749-1a9d-4613-a54b-9f9a4378ae58 req-30439b7a-20d5-4760-b284-a0fc60ecb7ca service nova] Creating event network-changed:c9330f0b-a90e-45e8-ab95-6401cdf4237e for instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 on hv-cinder-85638 Sep 13 06:45:17.707583 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-7eb6e749-1a9d-4613-a54b-9f9a4378ae58 req-30439b7a-20d5-4760-b284-a0fc60ecb7ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033706 Sep 13 06:45:17.708173 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 376/739] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:18.324623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d38c9028-9bd5-49f7-9ac7-ac0dab505bcd tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:18.325231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d38c9028-9bd5-49f7-9ac7-ac0dab505bcd tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:18.332220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d38c9028-9bd5-49f7-9ac7-ac0dab505bcd tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:18.332703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d38c9028-9bd5-49f7-9ac7-ac0dab505bcd tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:18.333139 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d38c9028-9bd5-49f7-9ac7-ac0dab505bcd tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:18.333828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d38c9028-9bd5-49f7-9ac7-ac0dab505bcd tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:18.334288 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d38c9028-9bd5-49f7-9ac7-ac0dab505bcd tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:18.334716 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d38c9028-9bd5-49f7-9ac7-ac0dab505bcd tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:18.460213 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-d38c9028-9bd5-49f7-9ac7-ac0dab505bcd tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:18.467922 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d38c9028-9bd5-49f7-9ac7-ac0dab505bcd tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1363 microversion: 2.1 time: 0.147183 Sep 13 06:45:18.468491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 364/740] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:18 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:18.878826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-01de785e-2f1c-4029-9f1b-b63ad61022c0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:18.879427 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-01de785e-2f1c-4029-9f1b-b63ad61022c0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:18.886353 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01de785e-2f1c-4029-9f1b-b63ad61022c0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:18.886844 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01de785e-2f1c-4029-9f1b-b63ad61022c0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:18.887283 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01de785e-2f1c-4029-9f1b-b63ad61022c0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:18.888003 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01de785e-2f1c-4029-9f1b-b63ad61022c0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:18.888463 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01de785e-2f1c-4029-9f1b-b63ad61022c0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:18.888894 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-01de785e-2f1c-4029-9f1b-b63ad61022c0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:19.009497 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.objects.instance [None req-01de785e-2f1c-4029-9f1b-b63ad61022c0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lazy-loading 'services' on Instance uuid d2001137-a4ff-4946-bc5e-56f38c00f36e {{(pid=132399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:45:19.120057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-01de785e-2f1c-4029-9f1b-b63ad61022c0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments/b1646bb9-d323-44f2-956c-9e2cd8a0c06d" status: 202 len: 0 microversion: 2.1 time: 0.245310 Sep 13 06:45:19.120727 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 377/741] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:45:18 2022] DELETE /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments/b1646bb9-d323-44f2-956c-9e2cd8a0c06d => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:45:19.129052 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1910be34-742b-4f93-852c-6edefaef2f17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:19.131243 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1910be34-742b-4f93-852c-6edefaef2f17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:19.137202 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1910be34-742b-4f93-852c-6edefaef2f17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:19.137691 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1910be34-742b-4f93-852c-6edefaef2f17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:19.138133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1910be34-742b-4f93-852c-6edefaef2f17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:19.138828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1910be34-742b-4f93-852c-6edefaef2f17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:19.139290 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1910be34-742b-4f93-852c-6edefaef2f17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:19.139751 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1910be34-742b-4f93-852c-6edefaef2f17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:19.169155 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1910be34-742b-4f93-852c-6edefaef2f17 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Sep 13 06:45:19.169714 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 365/742] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:45:19 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:19.491935 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-212a5570-6aac-423d-b4a7-5c699fdc7b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:19.492658 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-212a5570-6aac-423d-b4a7-5c699fdc7b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:19.498747 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-212a5570-6aac-423d-b4a7-5c699fdc7b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:19.499223 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-212a5570-6aac-423d-b4a7-5c699fdc7b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:19.499685 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-212a5570-6aac-423d-b4a7-5c699fdc7b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:19.500360 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-212a5570-6aac-423d-b4a7-5c699fdc7b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:19.500808 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-212a5570-6aac-423d-b4a7-5c699fdc7b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:19.501222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-212a5570-6aac-423d-b4a7-5c699fdc7b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:19.636478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-212a5570-6aac-423d-b4a7-5c699fdc7b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:19.644127 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-212a5570-6aac-423d-b4a7-5c699fdc7b3c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1363 microversion: 2.1 time: 0.156481 Sep 13 06:45:19.644699 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 378/743] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:19 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:45:20.183316 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7d73d3e4-8763-4e27-af6a-5580274d6e73 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:20.185502 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7d73d3e4-8763-4e27-af6a-5580274d6e73 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:20.191939 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d73d3e4-8763-4e27-af6a-5580274d6e73 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:20.192430 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d73d3e4-8763-4e27-af6a-5580274d6e73 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:20.192870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d73d3e4-8763-4e27-af6a-5580274d6e73 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:20.193559 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d73d3e4-8763-4e27-af6a-5580274d6e73 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:20.194019 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d73d3e4-8763-4e27-af6a-5580274d6e73 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:20.194445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d73d3e4-8763-4e27-af6a-5580274d6e73 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:20.224060 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7d73d3e4-8763-4e27-af6a-5580274d6e73 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Sep 13 06:45:20.224621 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 366/744] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:45:20 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:20.667718 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1c3d2c8e-1a64-4a22-a07f-f36f89bdc6e1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:20.668351 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1c3d2c8e-1a64-4a22-a07f-f36f89bdc6e1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:20.676298 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1c3d2c8e-1a64-4a22-a07f-f36f89bdc6e1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:20.676777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1c3d2c8e-1a64-4a22-a07f-f36f89bdc6e1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:20.677207 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1c3d2c8e-1a64-4a22-a07f-f36f89bdc6e1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:20.677896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1c3d2c8e-1a64-4a22-a07f-f36f89bdc6e1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:20.678349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1c3d2c8e-1a64-4a22-a07f-f36f89bdc6e1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:20.678774 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1c3d2c8e-1a64-4a22-a07f-f36f89bdc6e1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:20.813691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1c3d2c8e-1a64-4a22-a07f-f36f89bdc6e1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:20.822270 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1c3d2c8e-1a64-4a22-a07f-f36f89bdc6e1 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1363 microversion: 2.1 time: 0.158646 Sep 13 06:45:20.822874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 379/745] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:20 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:21.237112 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0cb5cb35-af4e-4d86-8db0-0d17b2abab97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:21.239315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0cb5cb35-af4e-4d86-8db0-0d17b2abab97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:21.245646 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0cb5cb35-af4e-4d86-8db0-0d17b2abab97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:21.246124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0cb5cb35-af4e-4d86-8db0-0d17b2abab97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:21.246651 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0cb5cb35-af4e-4d86-8db0-0d17b2abab97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:21.247337 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0cb5cb35-af4e-4d86-8db0-0d17b2abab97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:21.247810 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0cb5cb35-af4e-4d86-8db0-0d17b2abab97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:21.248231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0cb5cb35-af4e-4d86-8db0-0d17b2abab97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:21.279905 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0cb5cb35-af4e-4d86-8db0-0d17b2abab97 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047033 Sep 13 06:45:21.280690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 367/746] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:45:21 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:45:21.848474 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-25d9eeb5-672b-46d5-8d70-5f0eac5b8602 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:21.849117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-25d9eeb5-672b-46d5-8d70-5f0eac5b8602 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:21.855521 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25d9eeb5-672b-46d5-8d70-5f0eac5b8602 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:21.856007 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25d9eeb5-672b-46d5-8d70-5f0eac5b8602 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:21.856440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25d9eeb5-672b-46d5-8d70-5f0eac5b8602 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:21.857132 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25d9eeb5-672b-46d5-8d70-5f0eac5b8602 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:21.857588 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25d9eeb5-672b-46d5-8d70-5f0eac5b8602 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:21.858012 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-25d9eeb5-672b-46d5-8d70-5f0eac5b8602 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:21.984390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-25d9eeb5-672b-46d5-8d70-5f0eac5b8602 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:21.991934 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-25d9eeb5-672b-46d5-8d70-5f0eac5b8602 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1363 microversion: 2.1 time: 0.147388 Sep 13 06:45:21.992495 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 380/747] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:21 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:22.293854 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d2881d81-3cef-4870-b2da-92c5f6d1f3af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:22.296064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d2881d81-3cef-4870-b2da-92c5f6d1f3af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:22.303162 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d2881d81-3cef-4870-b2da-92c5f6d1f3af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:22.303672 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d2881d81-3cef-4870-b2da-92c5f6d1f3af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:22.304107 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d2881d81-3cef-4870-b2da-92c5f6d1f3af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:22.304789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d2881d81-3cef-4870-b2da-92c5f6d1f3af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:22.305238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d2881d81-3cef-4870-b2da-92c5f6d1f3af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:22.305659 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d2881d81-3cef-4870-b2da-92c5f6d1f3af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:22.335415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d2881d81-3cef-4870-b2da-92c5f6d1f3af tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045479 Sep 13 06:45:22.335962 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 368/748] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:45:22 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 06:45:22.416481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1836a6a2-b8e4-4fc4-9425-d485b24c2965 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:22.417066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1836a6a2-b8e4-4fc4-9425-d485b24c2965 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:22.422935 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1836a6a2-b8e4-4fc4-9425-d485b24c2965 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:22.423455 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1836a6a2-b8e4-4fc4-9425-d485b24c2965 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:22.423899 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1836a6a2-b8e4-4fc4-9425-d485b24c2965 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:22.424591 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1836a6a2-b8e4-4fc4-9425-d485b24c2965 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:22.425048 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1836a6a2-b8e4-4fc4-9425-d485b24c2965 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:22.425478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1836a6a2-b8e4-4fc4-9425-d485b24c2965 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:22.449620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1836a6a2-b8e4-4fc4-9425-d485b24c2965 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:45:22.527247 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1836a6a2-b8e4-4fc4-9425-d485b24c2965 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 204 len: 0 microversion: 2.1 time: 0.114584 Sep 13 06:45:22.528186 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 381/749] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:45:22 2022] DELETE /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:45:22.537456 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1c7bb397-aa1f-40ec-b472-592719ead4d0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:22.538072 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1c7bb397-aa1f-40ec-b472-592719ead4d0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:22.544324 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c7bb397-aa1f-40ec-b472-592719ead4d0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:22.544752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c7bb397-aa1f-40ec-b472-592719ead4d0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:22.545196 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c7bb397-aa1f-40ec-b472-592719ead4d0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:22.545901 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c7bb397-aa1f-40ec-b472-592719ead4d0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:22.546361 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c7bb397-aa1f-40ec-b472-592719ead4d0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:22.546803 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1c7bb397-aa1f-40ec-b472-592719ead4d0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:22.686469 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1c7bb397-aa1f-40ec-b472-592719ead4d0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:22.694688 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1c7bb397-aa1f-40ec-b472-592719ead4d0 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1689 microversion: 2.1 time: 0.162344 Sep 13 06:45:22.695265 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 369/750] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:22 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:45:23.014542 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-561cc245-0725-46b1-9434-c2d07020a053 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:23.015243 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-561cc245-0725-46b1-9434-c2d07020a053 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:23.022091 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-561cc245-0725-46b1-9434-c2d07020a053 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:23.022577 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-561cc245-0725-46b1-9434-c2d07020a053 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:23.023010 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-561cc245-0725-46b1-9434-c2d07020a053 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:23.023739 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-561cc245-0725-46b1-9434-c2d07020a053 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:23.024192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-561cc245-0725-46b1-9434-c2d07020a053 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:23.024613 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-561cc245-0725-46b1-9434-c2d07020a053 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:23.154151 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-561cc245-0725-46b1-9434-c2d07020a053 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:23.162239 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-561cc245-0725-46b1-9434-c2d07020a053 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1363 microversion: 2.1 time: 0.151994 Sep 13 06:45:23.162798 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 382/751] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:23 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:23.718364 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-06155552-e646-4838-9a1b-9aa07ddc2716 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:23.718980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-06155552-e646-4838-9a1b-9aa07ddc2716 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:23.725633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06155552-e646-4838-9a1b-9aa07ddc2716 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:23.726130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06155552-e646-4838-9a1b-9aa07ddc2716 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:23.726598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06155552-e646-4838-9a1b-9aa07ddc2716 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:23.727319 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06155552-e646-4838-9a1b-9aa07ddc2716 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:23.727806 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06155552-e646-4838-9a1b-9aa07ddc2716 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:23.728238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06155552-e646-4838-9a1b-9aa07ddc2716 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:23.854711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-06155552-e646-4838-9a1b-9aa07ddc2716 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:23.862966 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-06155552-e646-4838-9a1b-9aa07ddc2716 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1689 microversion: 2.1 time: 0.148736 Sep 13 06:45:23.863553 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 370/752] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:23 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:24.184917 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c4626307-60c4-480f-ae01-da7569dcb04f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:24.185525 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c4626307-60c4-480f-ae01-da7569dcb04f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:24.191776 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4626307-60c4-480f-ae01-da7569dcb04f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:24.192252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4626307-60c4-480f-ae01-da7569dcb04f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:24.192681 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4626307-60c4-480f-ae01-da7569dcb04f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:24.193356 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4626307-60c4-480f-ae01-da7569dcb04f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:24.193798 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4626307-60c4-480f-ae01-da7569dcb04f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:24.194212 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c4626307-60c4-480f-ae01-da7569dcb04f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:24.323192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c4626307-60c4-480f-ae01-da7569dcb04f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:24.330897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c4626307-60c4-480f-ae01-da7569dcb04f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1363 microversion: 2.1 time: 0.149708 Sep 13 06:45:24.331519 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 383/753] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:24 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:24.760959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-606b8f19-d4f3-4043-bc85-2091c6b1d479 req-4b70391e-5ba6-4815-a4dc-b2104f918657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b94d975-3eb2-4a82-bafe-c0b5a442f122", "name": "network-vif-plugged", "status": "completed", "tag": "c9330f0b-a90e-45e8-ab95-6401cdf4237e"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:24.771334 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-606b8f19-d4f3-4043-bc85-2091c6b1d479 req-4b70391e-5ba6-4815-a4dc-b2104f918657 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:24.771836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-606b8f19-d4f3-4043-bc85-2091c6b1d479 req-4b70391e-5ba6-4815-a4dc-b2104f918657 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:24.772264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-606b8f19-d4f3-4043-bc85-2091c6b1d479 req-4b70391e-5ba6-4815-a4dc-b2104f918657 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:24.783971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-606b8f19-d4f3-4043-bc85-2091c6b1d479 req-4b70391e-5ba6-4815-a4dc-b2104f918657 service nova] Creating event network-vif-plugged:c9330f0b-a90e-45e8-ab95-6401cdf4237e for instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 on hv-cinder-85638 Sep 13 06:45:24.789030 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-606b8f19-d4f3-4043-bc85-2091c6b1d479 req-4b70391e-5ba6-4815-a4dc-b2104f918657 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031465 Sep 13 06:45:24.789614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 371/754] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:24.885902 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-74937d54-0999-4cf7-8109-dbc98a431730 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:24.886508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-74937d54-0999-4cf7-8109-dbc98a431730 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:24.888440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:24.889098 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=6 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:24.900900 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74937d54-0999-4cf7-8109-dbc98a431730 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:24.901645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74937d54-0999-4cf7-8109-dbc98a431730 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:24.902259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74937d54-0999-4cf7-8109-dbc98a431730 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:24.903146 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74937d54-0999-4cf7-8109-dbc98a431730 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:24.903696 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74937d54-0999-4cf7-8109-dbc98a431730 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:24.904123 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74937d54-0999-4cf7-8109-dbc98a431730 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:25.031251 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-74937d54-0999-4cf7-8109-dbc98a431730 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:25.039168 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-74937d54-0999-4cf7-8109-dbc98a431730 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1689 microversion: 2.1 time: 0.157106 Sep 13 06:45:25.039765 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 384/755] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:24 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:25.351209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=6 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:25.355279 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4fd68cee-9bad-4115-8f17-648dca2eb344 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:25.355997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4fd68cee-9bad-4115-8f17-648dca2eb344 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:25.362943 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fd68cee-9bad-4115-8f17-648dca2eb344 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:25.369264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fd68cee-9bad-4115-8f17-648dca2eb344 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:25.369264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fd68cee-9bad-4115-8f17-648dca2eb344 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:25.369264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fd68cee-9bad-4115-8f17-648dca2eb344 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:25.369264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fd68cee-9bad-4115-8f17-648dca2eb344 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:25.369645 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4fd68cee-9bad-4115-8f17-648dca2eb344 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:25.495949 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4fd68cee-9bad-4115-8f17-648dca2eb344 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:25.504316 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4fd68cee-9bad-4115-8f17-648dca2eb344 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1363 microversion: 2.1 time: 0.154064 Sep 13 06:45:25.504887 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 372/756] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:25 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:26.062298 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ad210575-2b45-4120-b128-64733d6f0a6a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:26.062911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ad210575-2b45-4120-b128-64733d6f0a6a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:26.068789 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad210575-2b45-4120-b128-64733d6f0a6a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:26.069268 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad210575-2b45-4120-b128-64733d6f0a6a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:26.069697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad210575-2b45-4120-b128-64733d6f0a6a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:26.070379 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad210575-2b45-4120-b128-64733d6f0a6a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:26.070825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad210575-2b45-4120-b128-64733d6f0a6a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:26.071241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad210575-2b45-4120-b128-64733d6f0a6a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:26.075099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:26.210238 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ad210575-2b45-4120-b128-64733d6f0a6a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:26.217871 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ad210575-2b45-4120-b128-64733d6f0a6a tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1689 microversion: 2.1 time: 0.159522 Sep 13 06:45:26.218439 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 385/757] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:26 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:26.527168 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5e0e362a-f4e5-4d05-9db1-98e09cd5fa4c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:26.527733 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5e0e362a-f4e5-4d05-9db1-98e09cd5fa4c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:26.534333 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e0e362a-f4e5-4d05-9db1-98e09cd5fa4c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:26.534827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e0e362a-f4e5-4d05-9db1-98e09cd5fa4c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:26.535265 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e0e362a-f4e5-4d05-9db1-98e09cd5fa4c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:26.535998 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e0e362a-f4e5-4d05-9db1-98e09cd5fa4c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:26.536456 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e0e362a-f4e5-4d05-9db1-98e09cd5fa4c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:26.536885 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5e0e362a-f4e5-4d05-9db1-98e09cd5fa4c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:26.662636 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5e0e362a-f4e5-4d05-9db1-98e09cd5fa4c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:26.670435 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5e0e362a-f4e5-4d05-9db1-98e09cd5fa4c tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1363 microversion: 2.1 time: 0.147184 Sep 13 06:45:26.671016 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 373/758] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:26 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:27.244802 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-84b03153-6544-4b02-b43a-9c5e4f68a8d6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:27.245469 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-84b03153-6544-4b02-b43a-9c5e4f68a8d6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:27.251881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84b03153-6544-4b02-b43a-9c5e4f68a8d6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:27.252471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84b03153-6544-4b02-b43a-9c5e4f68a8d6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:27.252915 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84b03153-6544-4b02-b43a-9c5e4f68a8d6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:27.253649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84b03153-6544-4b02-b43a-9c5e4f68a8d6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:27.254110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84b03153-6544-4b02-b43a-9c5e4f68a8d6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:27.254537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-84b03153-6544-4b02-b43a-9c5e4f68a8d6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:27.382800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-84b03153-6544-4b02-b43a-9c5e4f68a8d6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:27.390439 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-84b03153-6544-4b02-b43a-9c5e4f68a8d6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1689 microversion: 2.1 time: 0.150253 Sep 13 06:45:27.390995 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 386/759] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:27 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:27.693900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f495aab3-7b7b-4808-8bf6-3bb829ab70d8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:27.694514 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f495aab3-7b7b-4808-8bf6-3bb829ab70d8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:27.700947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f495aab3-7b7b-4808-8bf6-3bb829ab70d8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:27.701439 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f495aab3-7b7b-4808-8bf6-3bb829ab70d8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:27.701884 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f495aab3-7b7b-4808-8bf6-3bb829ab70d8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:27.702582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f495aab3-7b7b-4808-8bf6-3bb829ab70d8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:27.703042 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f495aab3-7b7b-4808-8bf6-3bb829ab70d8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:27.703507 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f495aab3-7b7b-4808-8bf6-3bb829ab70d8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:28.151522 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-84b99ea9-e354-4a38-9bc7-2345d05673f9 req-2f54a6e5-9347-490a-9ca6-4eca1dea71a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2001137-a4ff-4946-bc5e-56f38c00f36e", "name": "network-vif-deleted", "tag": "48d46bd9-6b3e-4011-86f2-51e97c672d79"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:28.161311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-84b99ea9-e354-4a38-9bc7-2345d05673f9 req-2f54a6e5-9347-490a-9ca6-4eca1dea71a7 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:28.161916 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-84b99ea9-e354-4a38-9bc7-2345d05673f9 req-2f54a6e5-9347-490a-9ca6-4eca1dea71a7 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:28.162592 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-84b99ea9-e354-4a38-9bc7-2345d05673f9 req-2f54a6e5-9347-490a-9ca6-4eca1dea71a7 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:28.175057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-84b99ea9-e354-4a38-9bc7-2345d05673f9 req-2f54a6e5-9347-490a-9ca6-4eca1dea71a7 service nova] Creating event network-vif-deleted:48d46bd9-6b3e-4011-86f2-51e97c672d79 for instance d2001137-a4ff-4946-bc5e-56f38c00f36e on hv-cinder-85638 Sep 13 06:45:28.176808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f495aab3-7b7b-4808-8bf6-3bb829ab70d8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:28.181301 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-84b99ea9-e354-4a38-9bc7-2345d05673f9 req-2f54a6e5-9347-490a-9ca6-4eca1dea71a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032821 Sep 13 06:45:28.182136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 387/760] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:28.185866 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f495aab3-7b7b-4808-8bf6-3bb829ab70d8 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1363 microversion: 2.1 time: 0.496078 Sep 13 06:45:28.186470 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 374/761] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:27 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1363 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:28.415004 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-acd3c175-ef47-4af5-b930-768147cc4b99 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:28.415717 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-acd3c175-ef47-4af5-b930-768147cc4b99 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:28.421794 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd3c175-ef47-4af5-b930-768147cc4b99 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:28.422276 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd3c175-ef47-4af5-b930-768147cc4b99 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:28.422709 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd3c175-ef47-4af5-b930-768147cc4b99 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:28.423937 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd3c175-ef47-4af5-b930-768147cc4b99 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:28.424395 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd3c175-ef47-4af5-b930-768147cc4b99 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:28.424821 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acd3c175-ef47-4af5-b930-768147cc4b99 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:28.488975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-acd3c175-ef47-4af5-b930-768147cc4b99 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:28.497854 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-acd3c175-ef47-4af5-b930-768147cc4b99 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 200 len: 1621 microversion: 2.1 time: 0.087795 Sep 13 06:45:28.498480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 388/762] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:28 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 1621 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:29.210703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-47637cfa-1dfb-4b1f-9b0a-836815c05a48 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:29.211920 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-47637cfa-1dfb-4b1f-9b0a-836815c05a48 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:29.218740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-47637cfa-1dfb-4b1f-9b0a-836815c05a48 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:29.219233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-47637cfa-1dfb-4b1f-9b0a-836815c05a48 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:29.219697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-47637cfa-1dfb-4b1f-9b0a-836815c05a48 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:29.220988 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-47637cfa-1dfb-4b1f-9b0a-836815c05a48 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:29.221461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-47637cfa-1dfb-4b1f-9b0a-836815c05a48 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:29.221888 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-47637cfa-1dfb-4b1f-9b0a-836815c05a48 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:29.359824 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-47637cfa-1dfb-4b1f-9b0a-836815c05a48 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:29.363727 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:29.369357 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-47637cfa-1dfb-4b1f-9b0a-836815c05a48 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1549 microversion: 2.1 time: 0.163075 Sep 13 06:45:29.370437 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 375/763] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:29 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:29.391972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-73f76a03-ea16-4d82-8e54-b017a9e70348 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:29.393226 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-73f76a03-ea16-4d82-8e54-b017a9e70348 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:29.399178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-73f76a03-ea16-4d82-8e54-b017a9e70348 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:29.399701 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-73f76a03-ea16-4d82-8e54-b017a9e70348 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:29.400136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-73f76a03-ea16-4d82-8e54-b017a9e70348 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:29.400855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-73f76a03-ea16-4d82-8e54-b017a9e70348 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:29.401309 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-73f76a03-ea16-4d82-8e54-b017a9e70348 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:29.401730 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-73f76a03-ea16-4d82-8e54-b017a9e70348 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:29.480488 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-73f76a03-ea16-4d82-8e54-b017a9e70348 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092381 Sep 13 06:45:29.481110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 389/764] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Sep 13 06:45:29 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:29.521894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:29.522537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: d2001137-a4ff-4946-bc5e-56f38c00f36e] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:29.529686 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:29.530248 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:29.530696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:29.531451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:29.531920 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:29.532354 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:29.547289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] HTTP exception thrown: Instance d2001137-a4ff-4946-bc5e-56f38c00f36e could not be found. Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Request method failure captured: Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e HTTP/1.1 Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUxj6MqqdqElfWqH5aL2gn96PspvAbbzhXgLFU2F58FTDBDdrp3Z0c7eG23xqOh3h_TUtlPq2VTks3rSAdpphS-zhqBW3JkCdCq4-0VW2eyujCWXjaQWWm-3_69zMNFPkvWhIwezm9zeAO9awvqOSnjKPXwSGxtcYdntZHsKh7LZj0 Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 2a2a801692c84c34b713aca165f69761 Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:45:29.549014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a2a801692c84c34b713aca165f69761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a2a801692c84c34b713aca165f69761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a2a801692c84c34b713aca165f69761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a2a801692c84c34b713aca165f69761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 2a2a801692c84c34b713aca165f69761 Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-ServerRescueNegativeTestJSON-1025991494-project Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 3a0a80a54cdc4107a508ca480b992319 Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1025991494-project Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance d2001137-a4ff-4946-bc5e-56f38c00f36e could not be found. Sep 13 06:45:29.550676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'd2001137-a4ff-4946-bc5e-56f38c00f36e'} Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2001137-a4ff-4946-bc5e-56f38c00f36e could not be found. Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:45:29.552001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2001137-a4ff-4946-bc5e-56f38c00f36e could not be found. Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2001137-a4ff-4946-bc5e-56f38c00f36e could not be found. Sep 13 06:45:29.554124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:45:29.555472 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Returning 404 to user: Instance d2001137-a4ff-4946-bc5e-56f38c00f36e could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:45:29.555472 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-71542a19-e250-4a88-9a2c-a5680c4aeb5b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e" status: 404 len: 111 microversion: 2.1 time: 0.033059 Sep 13 06:45:29.555472 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 376/765] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:29 2022] GET /compute/v2.1/servers/d2001137-a4ff-4946-bc5e-56f38c00f36e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 06:45:29.561315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2508d230-602e-4552-8ea1-3a4b9f8ebb21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '.version_select at 0x7fdc0d3cdaf0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:29.586161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2508d230-602e-4552-8ea1-3a4b9f8ebb21 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-635113787" status: 202 len: 0 microversion: 2.1 time: 0.028581 Sep 13 06:45:29.586904 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 390/766] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Sep 13 06:45:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-635113787 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:45:30.603705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-d683daaf-cf99-4432-b944-a83db73f10c5 req-2d9e180b-7de0-41e0-aa47-841ac31ed646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b94d975-3eb2-4a82-bafe-c0b5a442f122", "tag": "c9330f0b-a90e-45e8-ab95-6401cdf4237e"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:30.613587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-d683daaf-cf99-4432-b944-a83db73f10c5 req-2d9e180b-7de0-41e0-aa47-841ac31ed646 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:30.614220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-d683daaf-cf99-4432-b944-a83db73f10c5 req-2d9e180b-7de0-41e0-aa47-841ac31ed646 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:30.614650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-d683daaf-cf99-4432-b944-a83db73f10c5 req-2d9e180b-7de0-41e0-aa47-841ac31ed646 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:30.625455 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-d683daaf-cf99-4432-b944-a83db73f10c5 req-2d9e180b-7de0-41e0-aa47-841ac31ed646 service nova] Creating event network-changed:c9330f0b-a90e-45e8-ab95-6401cdf4237e for instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 on hv-cinder-85638 Sep 13 06:45:30.630388 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-d683daaf-cf99-4432-b944-a83db73f10c5 req-2d9e180b-7de0-41e0-aa47-841ac31ed646 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030561 Sep 13 06:45:30.630981 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 377/767] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:32.692710 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-71511fc1-dcde-4475-bcac-e45113789e61 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:32.693205 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-71511fc1-dcde-4475-bcac-e45113789e61 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:32.699211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71511fc1-dcde-4475-bcac-e45113789e61 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:32.699732 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71511fc1-dcde-4475-bcac-e45113789e61 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:32.700161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71511fc1-dcde-4475-bcac-e45113789e61 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:32.700841 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71511fc1-dcde-4475-bcac-e45113789e61 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:32.701289 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71511fc1-dcde-4475-bcac-e45113789e61 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:32.701707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71511fc1-dcde-4475-bcac-e45113789e61 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:32.726015 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-71511fc1-dcde-4475-bcac-e45113789e61 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:45:32.816461 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-71511fc1-dcde-4475-bcac-e45113789e61 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "DELETE /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 204 len: 0 microversion: 2.1 time: 0.127911 Sep 13 06:45:32.818489 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 391/768] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:45:32 2022] DELETE /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:45:32.827409 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0f32e11a-480d-4c08-9678-a2ce4204d8be tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:32.828114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0f32e11a-480d-4c08-9678-a2ce4204d8be tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:32.833818 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0f32e11a-480d-4c08-9678-a2ce4204d8be tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:32.834294 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0f32e11a-480d-4c08-9678-a2ce4204d8be tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:32.834761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0f32e11a-480d-4c08-9678-a2ce4204d8be tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:32.835418 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0f32e11a-480d-4c08-9678-a2ce4204d8be tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:32.835874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0f32e11a-480d-4c08-9678-a2ce4204d8be tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:32.836294 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0f32e11a-480d-4c08-9678-a2ce4204d8be tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:32.920975 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-68b7c930-d8df-478b-b57e-b3b991a7ff29 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1772654701"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:32.921610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-68b7c930-d8df-478b-b57e-b3b991a7ff29 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:32.928614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68b7c930-d8df-478b-b57e-b3b991a7ff29 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:32.929106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68b7c930-d8df-478b-b57e-b3b991a7ff29 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:32.929541 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68b7c930-d8df-478b-b57e-b3b991a7ff29 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:32.930236 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68b7c930-d8df-478b-b57e-b3b991a7ff29 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:32.930695 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68b7c930-d8df-478b-b57e-b3b991a7ff29 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:32.931120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68b7c930-d8df-478b-b57e-b3b991a7ff29 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:32.970309 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0f32e11a-480d-4c08-9678-a2ce4204d8be tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:32.978559 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0f32e11a-480d-4c08-9678-a2ce4204d8be tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1507 microversion: 2.1 time: 0.155926 Sep 13 06:45:32.979184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 392/769] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:32 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:33.069356 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.network.security_group_api [None req-68b7c930-d8df-478b-b57e-b3b991a7ff29 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Removing security group 42365a9b-062e-4658-b1ef-922e7f59526f from port a7742d75-3c78-40a9-8666-a3fc8f3dbe52 Sep 13 06:45:33.376659 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-68b7c930-d8df-478b-b57e-b3b991a7ff29 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "POST /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/action" status: 202 len: 0 microversion: 2.1 time: 0.637212 Sep 13 06:45:33.377359 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 378/770] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:45:32 2022] POST /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:45:33.386756 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-13dd4846-69a6-406a-96e6-a99a16734acf req-6ae4b5e8-e9a4-43da-93b8-5848abd72239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b451b5fc-70f0-4e75-b74a-c839fc998e38", "tag": "a7742d75-3c78-40a9-8666-a3fc8f3dbe52"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:33.396128 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-13dd4846-69a6-406a-96e6-a99a16734acf req-6ae4b5e8-e9a4-43da-93b8-5848abd72239 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:33.396608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-13dd4846-69a6-406a-96e6-a99a16734acf req-6ae4b5e8-e9a4-43da-93b8-5848abd72239 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:33.397032 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-13dd4846-69a6-406a-96e6-a99a16734acf req-6ae4b5e8-e9a4-43da-93b8-5848abd72239 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:33.414311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-13dd4846-69a6-406a-96e6-a99a16734acf req-6ae4b5e8-e9a4-43da-93b8-5848abd72239 service nova] Creating event network-changed:a7742d75-3c78-40a9-8666-a3fc8f3dbe52 for instance b451b5fc-70f0-4e75-b74a-c839fc998e38 on hv-cinder-85638 Sep 13 06:45:33.421022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-13dd4846-69a6-406a-96e6-a99a16734acf req-6ae4b5e8-e9a4-43da-93b8-5848abd72239 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037730 Sep 13 06:45:33.422003 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 393/771] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:34.002899 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5761c492-8439-4267-b975-bf281bb27614 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:34.003535 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5761c492-8439-4267-b975-bf281bb27614 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:34.009833 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5761c492-8439-4267-b975-bf281bb27614 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:34.010323 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5761c492-8439-4267-b975-bf281bb27614 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:34.011500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5761c492-8439-4267-b975-bf281bb27614 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:34.012208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5761c492-8439-4267-b975-bf281bb27614 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:34.012673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5761c492-8439-4267-b975-bf281bb27614 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:34.013100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5761c492-8439-4267-b975-bf281bb27614 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:34.403117 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5761c492-8439-4267-b975-bf281bb27614 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:34.411109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5761c492-8439-4267-b975-bf281bb27614 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1507 microversion: 2.1 time: 0.412847 Sep 13 06:45:34.411503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 379/772] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:33 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:35.437141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0a2921b4-4e3f-4381-89e3-6179310abf64 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:35.438507 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0a2921b4-4e3f-4381-89e3-6179310abf64 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:35.444531 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-aa101b67-b78b-4456-9d1f-cdd6f728dc25 req-3bc308e8-3c2c-48aa-9e47-1be36f5d76f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558b2e47-a791-433b-902c-8b72a0a0e78f", "name": "network-vif-deleted", "tag": "24bef117-21a5-4e33-9c7e-eae40346e83c"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:35.446676 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a2921b4-4e3f-4381-89e3-6179310abf64 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:35.447394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a2921b4-4e3f-4381-89e3-6179310abf64 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:35.448067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a2921b4-4e3f-4381-89e3-6179310abf64 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:35.448987 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a2921b4-4e3f-4381-89e3-6179310abf64 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:35.450511 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a2921b4-4e3f-4381-89e3-6179310abf64 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:35.451544 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a2921b4-4e3f-4381-89e3-6179310abf64 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:35.459823 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-aa101b67-b78b-4456-9d1f-cdd6f728dc25 req-3bc308e8-3c2c-48aa-9e47-1be36f5d76f2 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:35.460970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-aa101b67-b78b-4456-9d1f-cdd6f728dc25 req-3bc308e8-3c2c-48aa-9e47-1be36f5d76f2 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:35.462420 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-aa101b67-b78b-4456-9d1f-cdd6f728dc25 req-3bc308e8-3c2c-48aa-9e47-1be36f5d76f2 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:35.481493 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-aa101b67-b78b-4456-9d1f-cdd6f728dc25 req-3bc308e8-3c2c-48aa-9e47-1be36f5d76f2 service nova] Creating event network-vif-deleted:24bef117-21a5-4e33-9c7e-eae40346e83c for instance 558b2e47-a791-433b-902c-8b72a0a0e78f on hv-cinder-85638 Sep 13 06:45:35.488471 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-aa101b67-b78b-4456-9d1f-cdd6f728dc25 req-3bc308e8-3c2c-48aa-9e47-1be36f5d76f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049463 Sep 13 06:45:35.500555 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 380/773] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:45:35.544122 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0a2921b4-4e3f-4381-89e3-6179310abf64 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:35.567636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0a2921b4-4e3f-4381-89e3-6179310abf64 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1292 microversion: 2.1 time: 0.136958 Sep 13 06:45:35.568946 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 394/774] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:35 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1292 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:35.605864 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0bca579c-1ca5-4dd0-91da-503e81c35540 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:35.607201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0bca579c-1ca5-4dd0-91da-503e81c35540 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:35.614239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bca579c-1ca5-4dd0-91da-503e81c35540 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:35.615007 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bca579c-1ca5-4dd0-91da-503e81c35540 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:35.615477 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bca579c-1ca5-4dd0-91da-503e81c35540 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:35.616186 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bca579c-1ca5-4dd0-91da-503e81c35540 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:35.617186 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bca579c-1ca5-4dd0-91da-503e81c35540 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:35.617625 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bca579c-1ca5-4dd0-91da-503e81c35540 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:35.707971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-0bca579c-1ca5-4dd0-91da-503e81c35540 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lazy-loading 'services' on Instance uuid b451b5fc-70f0-4e75-b74a-c839fc998e38 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:45:35.790021 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0bca579c-1ca5-4dd0-91da-503e81c35540 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments/52db33f3-c15a-435f-a2ae-274a14581946" status: 202 len: 0 microversion: 2.1 time: 0.187936 Sep 13 06:45:35.791316 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 381/775] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:45:35 2022] DELETE /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments/52db33f3-c15a-435f-a2ae-274a14581946 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:45:35.799220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-10d76986-c535-405c-85f5-102168feff2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:35.801414 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-10d76986-c535-405c-85f5-102168feff2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:35.807644 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10d76986-c535-405c-85f5-102168feff2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:35.808011 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10d76986-c535-405c-85f5-102168feff2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:35.808446 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10d76986-c535-405c-85f5-102168feff2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:35.809146 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10d76986-c535-405c-85f5-102168feff2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:35.809602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10d76986-c535-405c-85f5-102168feff2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:35.810021 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10d76986-c535-405c-85f5-102168feff2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:35.840371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-10d76986-c535-405c-85f5-102168feff2a tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 Sep 13 06:45:35.841244 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 395/776] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:45:35 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:36.593164 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:36.596144 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:36.603620 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:36.604113 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:36.604830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:36.605713 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:36.606523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:36.607006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:36.642441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:36.643155 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:36.643618 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:36.644064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lazy-loading 'fault' on Instance uuid 558b2e47-a791-433b-902c-8b72a0a0e78f {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:45:36.715094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:36.723054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f3e66a4b-2893-486d-9821-25130f2d46b4 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 200 len: 1311 microversion: 2.1 time: 0.134827 Sep 13 06:45:36.723688 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 382/777] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:36 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 1311 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:36.853355 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ffb85b32-85d3-454f-959a-8c058f54b711 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:36.855570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ffb85b32-85d3-454f-959a-8c058f54b711 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:36.862509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ffb85b32-85d3-454f-959a-8c058f54b711 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:36.862992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ffb85b32-85d3-454f-959a-8c058f54b711 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:36.863463 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ffb85b32-85d3-454f-959a-8c058f54b711 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:36.864407 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ffb85b32-85d3-454f-959a-8c058f54b711 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:36.864691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ffb85b32-85d3-454f-959a-8c058f54b711 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:36.865114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ffb85b32-85d3-454f-959a-8c058f54b711 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:36.894572 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ffb85b32-85d3-454f-959a-8c058f54b711 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045092 Sep 13 06:45:36.895132 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 396/778] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:45:36 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:37.526271 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-a42a66c4-51bd-4f7a-afbc-367a23f98b0e req-76dbcbaf-1365-4706-b14e-5738582e5b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b451b5fc-70f0-4e75-b74a-c839fc998e38", "tag": "a7742d75-3c78-40a9-8666-a3fc8f3dbe52"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:37.536460 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a42a66c4-51bd-4f7a-afbc-367a23f98b0e req-76dbcbaf-1365-4706-b14e-5738582e5b07 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.537195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a42a66c4-51bd-4f7a-afbc-367a23f98b0e req-76dbcbaf-1365-4706-b14e-5738582e5b07 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.537624 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a42a66c4-51bd-4f7a-afbc-367a23f98b0e req-76dbcbaf-1365-4706-b14e-5738582e5b07 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:37.549170 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-a42a66c4-51bd-4f7a-afbc-367a23f98b0e req-76dbcbaf-1365-4706-b14e-5738582e5b07 service nova] Creating event network-changed:a7742d75-3c78-40a9-8666-a3fc8f3dbe52 for instance b451b5fc-70f0-4e75-b74a-c839fc998e38 on hv-cinder-85638 Sep 13 06:45:37.553963 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-a42a66c4-51bd-4f7a-afbc-367a23f98b0e req-76dbcbaf-1365-4706-b14e-5738582e5b07 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031323 Sep 13 06:45:37.554754 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 383/779] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:37.749553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:37.750515 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 558b2e47-a791-433b-902c-8b72a0a0e78f] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:37.754185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:37.760278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.761325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.761992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:37.763145 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.763850 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.764697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:37.782188 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] HTTP exception thrown: Instance 558b2e47-a791-433b-902c-8b72a0a0e78f could not be found. Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Request method failure captured: Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f HTTP/1.1 Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUxj6MqqdqElfWqH5aL2gn96PspvAbbzhXgLFU2F58FTDBDdrp3Z0c7eG23xqOh3h_TUtlPq2VTks3rSAdpphS-zhqBW3JkCdCq4-0VW2eyujCWXjaQWWm-3_69zMNFPkvWhIwezm9zeAO9awvqOSnjKPXwSGxtcYdntZHsKh7LZj0 Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 2a2a801692c84c34b713aca165f69761 Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:45:37.784016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a2a801692c84c34b713aca165f69761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a2a801692c84c34b713aca165f69761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a2a801692c84c34b713aca165f69761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a2a801692c84c34b713aca165f69761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 2a2a801692c84c34b713aca165f69761 Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-ServerRescueNegativeTestJSON-1025991494-project Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 3a0a80a54cdc4107a508ca480b992319 Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1025991494-project Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 558b2e47-a791-433b-902c-8b72a0a0e78f could not be found. Sep 13 06:45:37.785674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '558b2e47-a791-433b-902c-8b72a0a0e78f'} Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558b2e47-a791-433b-902c-8b72a0a0e78f could not be found. Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:45:37.786570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558b2e47-a791-433b-902c-8b72a0a0e78f could not be found. Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558b2e47-a791-433b-902c-8b72a0a0e78f could not be found. Sep 13 06:45:37.788065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:37.789629 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Returning 404 to user: Instance 558b2e47-a791-433b-902c-8b72a0a0e78f could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:45:37.789730 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-acf973b1-ee4e-4026-915e-4ec3855f3c60 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f" status: 404 len: 111 microversion: 2.1 time: 0.041606 Sep 13 06:45:37.790350 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 397/780] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:37 2022] GET /compute/v2.1/servers/558b2e47-a791-433b-902c-8b72a0a0e78f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 06:45:37.801421 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-576e4966-6e6f-4bd9-9f83-a0ee9ad86fea tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:37.802291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-576e4966-6e6f-4bd9-9f83-a0ee9ad86fea tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:37.804490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:37.810344 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-576e4966-6e6f-4bd9-9f83-a0ee9ad86fea tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.810905 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-576e4966-6e6f-4bd9-9f83-a0ee9ad86fea tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.811436 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-576e4966-6e6f-4bd9-9f83-a0ee9ad86fea tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:37.812233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-576e4966-6e6f-4bd9-9f83-a0ee9ad86fea tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.812758 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-576e4966-6e6f-4bd9-9f83-a0ee9ad86fea tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.813280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-576e4966-6e6f-4bd9-9f83-a0ee9ad86fea tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:37.842485 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-576e4966-6e6f-4bd9-9f83-a0ee9ad86fea tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Going to try to terminate instance {{(pid=132398) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:45:37.907903 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2913236f-7643-45ec-aadd-af4c818693d7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:37.910103 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2913236f-7643-45ec-aadd-af4c818693d7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:37.918404 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2913236f-7643-45ec-aadd-af4c818693d7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.919129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2913236f-7643-45ec-aadd-af4c818693d7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.919903 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2913236f-7643-45ec-aadd-af4c818693d7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:37.920633 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2913236f-7643-45ec-aadd-af4c818693d7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.921090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2913236f-7643-45ec-aadd-af4c818693d7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.921518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2913236f-7643-45ec-aadd-af4c818693d7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:37.925530 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-576e4966-6e6f-4bd9-9f83-a0ee9ad86fea tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 204 len: 0 microversion: 2.1 time: 0.128548 Sep 13 06:45:37.926122 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 384/781] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:45:37 2022] DELETE /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:45:37.934932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-80155a3a-b793-481a-87c7-5d3999e4ec78 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:37.935886 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-80155a3a-b793-481a-87c7-5d3999e4ec78 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:37.942994 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-80155a3a-b793-481a-87c7-5d3999e4ec78 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.943724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-80155a3a-b793-481a-87c7-5d3999e4ec78 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.944330 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-80155a3a-b793-481a-87c7-5d3999e4ec78 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:37.945316 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-80155a3a-b793-481a-87c7-5d3999e4ec78 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.945919 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-80155a3a-b793-481a-87c7-5d3999e4ec78 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.946501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-80155a3a-b793-481a-87c7-5d3999e4ec78 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:37.952455 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2913236f-7643-45ec-aadd-af4c818693d7 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048509 Sep 13 06:45:37.953008 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 398/782] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:45:37 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 06:45:37.963503 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:37.964130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:37.970437 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.971138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.971602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:37.972337 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:37.972810 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:37.973227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:38.047041 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] HTTP exception thrown: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 is not attached to volume 52db33f3-c15a-435f-a2ae-274a14581946 Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Request method failure captured: Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: DELETE /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments/52db33f3-c15a-435f-a2ae-274a14581946 HTTP/1.1 Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICXOAXyrRBJMWlhhsDxdvu8ucI3paPj6hPpunh5WaM7v_PI6mJn0Yj9AH_lFEE2H0WJAxHTP6f__qhcaYC4pBe_Ow8tQUDxJPfYdQtOeMJreYhx0juakZ6a6zXvhn71roTRGNg2xrwRvZO2E9UgobOJ-urKIMIkDil4galArGOqf3Q0 Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: c53592d2364242099cedd8580f6af40d Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-TestMinimumBasicScenario-2077849691 Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:45:38.049970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c53592d2364242099cedd8580f6af40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c53592d2364242099cedd8580f6af40d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c53592d2364242099cedd8580f6af40d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c53592d2364242099cedd8580f6af40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-TestMinimumBasicScenario-2077849691 Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: c53592d2364242099cedd8580f6af40d Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2077849691 Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-TestMinimumBasicScenario-2077849691-project Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 48d416e061ed4cba9862d0ddab3672d8 Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-TestMinimumBasicScenario-2077849691-project Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:45:38.051631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 is not attached to volume 52db33f3-c15a-435f-a2ae-274a14581946 Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'server_id': 'b451b5fc-70f0-4e75-b74a-c839fc998e38', 'id': '52db33f3-c15a-435f-a2ae-274a14581946'} Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 52db33f3-c15a-435f-a2ae-274a14581946. Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:45:38.052822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 is not attached to volume 52db33f3-c15a-435f-a2ae-274a14581946 Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 is not attached to volume 52db33f3-c15a-435f-a2ae-274a14581946 Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:38.054228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Returning 404 to user: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 is not attached to volume 52db33f3-c15a-435f-a2ae-274a14581946 {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:45:38.055215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a9058b7e-617c-440b-98fa-2c8952e422ff tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments/52db33f3-c15a-435f-a2ae-274a14581946" status: 404 len: 154 microversion: 2.1 time: 0.092979 Sep 13 06:45:38.055215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 399/783] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:45:37 2022] DELETE /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38/os-volume_attachments/52db33f3-c15a-435f-a2ae-274a14581946 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 06:45:38.115577 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-80155a3a-b793-481a-87c7-5d3999e4ec78 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:38.123291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-80155a3a-b793-481a-87c7-5d3999e4ec78 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.192581 Sep 13 06:45:38.124167 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 385/784] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:37 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:45:39.147916 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f52b2100-9176-4da9-bdcd-0946cb1ecde6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:39.148526 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f52b2100-9176-4da9-bdcd-0946cb1ecde6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:39.154944 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f52b2100-9176-4da9-bdcd-0946cb1ecde6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:39.155465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f52b2100-9176-4da9-bdcd-0946cb1ecde6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:39.155907 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f52b2100-9176-4da9-bdcd-0946cb1ecde6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:39.156604 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f52b2100-9176-4da9-bdcd-0946cb1ecde6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:39.157057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f52b2100-9176-4da9-bdcd-0946cb1ecde6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:39.157538 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f52b2100-9176-4da9-bdcd-0946cb1ecde6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:39.196206 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0f39438e-ff4f-4321-989e-77d76f7082d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:39.196739 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0f39438e-ff4f-4321-989e-77d76f7082d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:39.203315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f39438e-ff4f-4321-989e-77d76f7082d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:39.204086 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f39438e-ff4f-4321-989e-77d76f7082d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:39.205279 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f39438e-ff4f-4321-989e-77d76f7082d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:39.205988 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f39438e-ff4f-4321-989e-77d76f7082d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:39.206445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f39438e-ff4f-4321-989e-77d76f7082d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:39.206871 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f39438e-ff4f-4321-989e-77d76f7082d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:39.231949 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0f39438e-ff4f-4321-989e-77d76f7082d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Going to try to terminate instance {{(pid=132398) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:45:39.299981 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f52b2100-9176-4da9-bdcd-0946cb1ecde6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:39.309684 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f52b2100-9176-4da9-bdcd-0946cb1ecde6 tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1521 microversion: 2.1 time: 0.165404 Sep 13 06:45:39.310559 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 400/785] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:39 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:39.323662 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0f39438e-ff4f-4321-989e-77d76f7082d5 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 204 len: 0 microversion: 2.1 time: 0.125182 Sep 13 06:45:39.323662 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 386/786] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:45:39 2022] DELETE /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 06:45:39.327970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4e3e8220-b909-4a84-94b4-8fe0f0c01f6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:39.328681 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4e3e8220-b909-4a84-94b4-8fe0f0c01f6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:39.335159 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4e3e8220-b909-4a84-94b4-8fe0f0c01f6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:39.335684 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4e3e8220-b909-4a84-94b4-8fe0f0c01f6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:39.336124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4e3e8220-b909-4a84-94b4-8fe0f0c01f6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:39.336824 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4e3e8220-b909-4a84-94b4-8fe0f0c01f6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:39.337284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4e3e8220-b909-4a84-94b4-8fe0f0c01f6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:39.337713 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4e3e8220-b909-4a84-94b4-8fe0f0c01f6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:39.537571 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4e3e8220-b909-4a84-94b4-8fe0f0c01f6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:39.545686 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4e3e8220-b909-4a84-94b4-8fe0f0c01f6b tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1554 microversion: 2.1 time: 0.222024 Sep 13 06:45:39.546194 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 387/787] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:39 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:39.568774 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-9a880408-cec0-4fae-bf45-e6ff95cc9098 req-33e9ac0c-c0c2-47da-b1be-5a73cdb8959b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b78adc0-900e-4630-beef-06cd4f0ae257", "name": "network-vif-deleted", "tag": "3173e994-892d-4ff5-b8b6-cc45a1a10369"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:39.578045 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-9a880408-cec0-4fae-bf45-e6ff95cc9098 req-33e9ac0c-c0c2-47da-b1be-5a73cdb8959b service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:39.578517 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-9a880408-cec0-4fae-bf45-e6ff95cc9098 req-33e9ac0c-c0c2-47da-b1be-5a73cdb8959b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:39.578940 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-9a880408-cec0-4fae-bf45-e6ff95cc9098 req-33e9ac0c-c0c2-47da-b1be-5a73cdb8959b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:39.589851 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-9a880408-cec0-4fae-bf45-e6ff95cc9098 req-33e9ac0c-c0c2-47da-b1be-5a73cdb8959b service nova] Creating event network-vif-deleted:3173e994-892d-4ff5-b8b6-cc45a1a10369 for instance 4b78adc0-900e-4630-beef-06cd4f0ae257 on hv-cinder-85638 Sep 13 06:45:39.594860 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-9a880408-cec0-4fae-bf45-e6ff95cc9098 req-33e9ac0c-c0c2-47da-b1be-5a73cdb8959b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029819 Sep 13 06:45:39.595482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 401/788] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:40.337926 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1b2c9ed2-726e-4a2d-99b7-8c62ee3f431d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:40.338534 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1b2c9ed2-726e-4a2d-99b7-8c62ee3f431d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:40.344883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b2c9ed2-726e-4a2d-99b7-8c62ee3f431d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:40.345364 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b2c9ed2-726e-4a2d-99b7-8c62ee3f431d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:40.345791 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b2c9ed2-726e-4a2d-99b7-8c62ee3f431d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:40.346470 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b2c9ed2-726e-4a2d-99b7-8c62ee3f431d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:40.346920 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b2c9ed2-726e-4a2d-99b7-8c62ee3f431d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:40.347341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1b2c9ed2-726e-4a2d-99b7-8c62ee3f431d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:40.410960 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1b2c9ed2-726e-4a2d-99b7-8c62ee3f431d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:40.419178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1b2c9ed2-726e-4a2d-99b7-8c62ee3f431d tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1479 microversion: 2.1 time: 0.085053 Sep 13 06:45:40.419801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 388/789] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:40 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1479 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:40.569820 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f987a221-d69c-4af7-a3d6-b361f530d3d3 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:40.570515 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f987a221-d69c-4af7-a3d6-b361f530d3d3 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:40.576733 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f987a221-d69c-4af7-a3d6-b361f530d3d3 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:40.577217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f987a221-d69c-4af7-a3d6-b361f530d3d3 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:40.577654 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f987a221-d69c-4af7-a3d6-b361f530d3d3 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:40.578342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f987a221-d69c-4af7-a3d6-b361f530d3d3 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:40.578793 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f987a221-d69c-4af7-a3d6-b361f530d3d3 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:40.579277 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f987a221-d69c-4af7-a3d6-b361f530d3d3 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:40.912018 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f987a221-d69c-4af7-a3d6-b361f530d3d3 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:40.919744 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f987a221-d69c-4af7-a3d6-b361f530d3d3 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1554 microversion: 2.1 time: 0.354567 Sep 13 06:45:40.920306 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 402/790] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:40 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1554 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:41.443962 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:41.444566 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:41.451789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:41.452373 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:41.453005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:41.453766 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:41.454889 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:41.455349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:41.487200 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:41.487722 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:41.488249 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:41.488687 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lazy-loading 'fault' on Instance uuid 4b78adc0-900e-4630-beef-06cd4f0ae257 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:45:41.528801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0a80a54cdc4107a508ca480b992319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2a801692c84c34b713aca165f69761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:41.536243 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-896cde5c-8e89-4c76-a614-2a693832833b tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 200 len: 1312 microversion: 2.1 time: 0.098150 Sep 13 06:45:41.536802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 389/791] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:41 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:41.943553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-02cb9352-4b4c-41eb-a309-cb213a83ad90 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:41.944156 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-02cb9352-4b4c-41eb-a309-cb213a83ad90 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:41.950549 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-02cb9352-4b4c-41eb-a309-cb213a83ad90 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:41.951026 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-02cb9352-4b4c-41eb-a309-cb213a83ad90 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:41.951490 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-02cb9352-4b4c-41eb-a309-cb213a83ad90 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:41.952172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-02cb9352-4b4c-41eb-a309-cb213a83ad90 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:41.952620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-02cb9352-4b4c-41eb-a309-cb213a83ad90 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:41.953040 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-02cb9352-4b4c-41eb-a309-cb213a83ad90 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:42.093081 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-02cb9352-4b4c-41eb-a309-cb213a83ad90 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:42.102816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-02cb9352-4b4c-41eb-a309-cb213a83ad90 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1554 microversion: 2.1 time: 0.163112 Sep 13 06:45:42.103521 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 403/792] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:41 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:42.435639 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-5b694f2e-cafb-4f27-9a2f-36b1ebcd2ede req-cf90c94f-0bb3-4b07-8dc6-a78f842e371a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b451b5fc-70f0-4e75-b74a-c839fc998e38", "name": "network-vif-deleted", "tag": "a7742d75-3c78-40a9-8666-a3fc8f3dbe52"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:42.445775 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5b694f2e-cafb-4f27-9a2f-36b1ebcd2ede req-cf90c94f-0bb3-4b07-8dc6-a78f842e371a service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:42.446404 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5b694f2e-cafb-4f27-9a2f-36b1ebcd2ede req-cf90c94f-0bb3-4b07-8dc6-a78f842e371a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:42.446674 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5b694f2e-cafb-4f27-9a2f-36b1ebcd2ede req-cf90c94f-0bb3-4b07-8dc6-a78f842e371a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:42.459899 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-5b694f2e-cafb-4f27-9a2f-36b1ebcd2ede req-cf90c94f-0bb3-4b07-8dc6-a78f842e371a service nova] Creating event network-vif-deleted:a7742d75-3c78-40a9-8666-a3fc8f3dbe52 for instance b451b5fc-70f0-4e75-b74a-c839fc998e38 on hv-cinder-85638 Sep 13 06:45:42.465629 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-5b694f2e-cafb-4f27-9a2f-36b1ebcd2ede req-cf90c94f-0bb3-4b07-8dc6-a78f842e371a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033603 Sep 13 06:45:42.466258 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 390/793] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:45:42.558490 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:42.559221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] [instance: 4b78adc0-900e-4630-beef-06cd4f0ae257] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:42.565741 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:42.566219 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:42.566650 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:42.567337 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:42.567809 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:42.569023 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:42.574149 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:42.586240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] HTTP exception thrown: Instance 4b78adc0-900e-4630-beef-06cd4f0ae257 could not be found. Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Request method failure captured: Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 HTTP/1.1 Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUxj6MqqdqElfWqH5aL2gn96PspvAbbzhXgLFU2F58FTDBDdrp3Z0c7eG23xqOh3h_TUtlPq2VTks3rSAdpphS-zhqBW3JkCdCq4-0VW2eyujCWXjaQWWm-3_69zMNFPkvWhIwezm9zeAO9awvqOSnjKPXwSGxtcYdntZHsKh7LZj0 Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 2a2a801692c84c34b713aca165f69761 Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:45:42.587325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a2a801692c84c34b713aca165f69761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a2a801692c84c34b713aca165f69761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a2a801692c84c34b713aca165f69761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a2a801692c84c34b713aca165f69761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 2a2a801692c84c34b713aca165f69761 Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1025991494 Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-ServerRescueNegativeTestJSON-1025991494-project Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 3a0a80a54cdc4107a508ca480b992319 Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1025991494-project Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 4b78adc0-900e-4630-beef-06cd4f0ae257 could not be found. Sep 13 06:45:42.588961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '4b78adc0-900e-4630-beef-06cd4f0ae257'} Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b78adc0-900e-4630-beef-06cd4f0ae257 could not be found. Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:45:42.589977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b78adc0-900e-4630-beef-06cd4f0ae257 could not be found. Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b78adc0-900e-4630-beef-06cd4f0ae257 could not be found. Sep 13 06:45:42.591454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:42.592549 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] Returning 404 to user: Instance 4b78adc0-900e-4630-beef-06cd4f0ae257 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:45:42.592549 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-65b7de34-9234-4760-8ef6-55911b17dafc tempest-ServerRescueNegativeTestJSON-1025991494 tempest-ServerRescueNegativeTestJSON-1025991494-project] 10.222.0.17 "GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257" status: 404 len: 111 microversion: 2.1 time: 0.035214 Sep 13 06:45:42.592549 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 404/794] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:42 2022] GET /compute/v2.1/servers/4b78adc0-900e-4630-beef-06cd4f0ae257 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:45:43.127094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:43.128106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:43.134748 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:43.135535 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:43.135997 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:43.136947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:43.137611 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:43.138076 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:43.160826 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:43.177172 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:43.177680 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:43.178120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:43.178583 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lazy-loading 'fault' on Instance uuid b451b5fc-70f0-4e75-b74a-c839fc998e38 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:45:43.257221 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d416e061ed4cba9862d0ddab3672d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53592d2364242099cedd8580f6af40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:43.264270 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-20f61fff-62b4-4518-81dd-7b35face27ea tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 200 len: 1348 microversion: 2.1 time: 0.141746 Sep 13 06:45:43.264848 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 391/795] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:43 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 1348 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:45:44.289867 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:44.291110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] [instance: b451b5fc-70f0-4e75-b74a-c839fc998e38] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:44.300053 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:44.300547 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:44.300974 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:44.301861 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:44.302505 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:44.303188 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:44.318358 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] HTTP exception thrown: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 could not be found. Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Request method failure captured: Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 HTTP/1.1 Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICXOAXyrRBJMWlhhsDxdvu8ucI3paPj6hPpunh5WaM7v_PI6mJn0Yj9AH_lFEE2H0WJAxHTP6f__qhcaYC4pBe_Ow8tQUDxJPfYdQtOeMJreYhx0juakZ6a6zXvhn71roTRGNg2xrwRvZO2E9UgobOJ-urKIMIkDil4galArGOqf3Q0 Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: c53592d2364242099cedd8580f6af40d Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-TestMinimumBasicScenario-2077849691 Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:45:44.320195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c53592d2364242099cedd8580f6af40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c53592d2364242099cedd8580f6af40d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c53592d2364242099cedd8580f6af40d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c53592d2364242099cedd8580f6af40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-TestMinimumBasicScenario-2077849691 Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: c53592d2364242099cedd8580f6af40d Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2077849691 Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-TestMinimumBasicScenario-2077849691-project Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 48d416e061ed4cba9862d0ddab3672d8 Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-TestMinimumBasicScenario-2077849691-project Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 could not be found. Sep 13 06:45:44.321582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': 'b451b5fc-70f0-4e75-b74a-c839fc998e38'} Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 could not be found. Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:45:44.322383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 could not be found. Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 could not be found. Sep 13 06:45:44.324217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:45:44.327522 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Returning 404 to user: Instance b451b5fc-70f0-4e75-b74a-c839fc998e38 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:45:44.327522 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8064e16b-fcd8-4405-95b4-675da02a9670 tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38" status: 404 len: 111 microversion: 2.1 time: 0.037408 Sep 13 06:45:44.330459 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-05a5993d-352f-42c9-b04a-0423ccdc41ce tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] Calling method '.version_select at 0x7fdc0d3f9ee0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:44.335260 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 405/796] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:45:44 2022] GET /compute/v2.1/servers/b451b5fc-70f0-4e75-b74a-c839fc998e38 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:45:44.353890 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-05a5993d-352f-42c9-b04a-0423ccdc41ce tempest-TestMinimumBasicScenario-2077849691 tempest-TestMinimumBasicScenario-2077849691-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-458133748" status: 202 len: 0 microversion: 2.1 time: 0.027178 Sep 13 06:45:44.355424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 392/797] 10.222.0.17 () {58 vars in 1269 bytes} [Tue Sep 13 06:45:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-458133748 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:45:53.168200 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8cd52f95-d829-4c8c-a119-b19d042286ae tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Action: 'create', calling method: .version_select at 0x7fdc0d8e30d0>, body: {"keypair": {"name": "tempest-keypair-992770201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHshtfZ+e/XjRyYf2yKGTFXBftH5QZF3ne4br44HF9eN+8zIUtVQb8dsCwHSVBzKsI67cifwuM61Hp4RaTk/+hSgn98ezO5iBsXVY2DSPI9sT1354QCa8U3wk1R+x7RGjQ=="}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:53.185114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-8cd52f95-d829-4c8c-a119-b19d042286ae tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Getting quotas for project 1a77de8686444581a7b5906cae6973f5. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:45:53.189079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-8cd52f95-d829-4c8c-a119-b19d042286ae tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Getting quotas for user 6b89305abaa14207b2840164c1a90e7b and project 1a77de8686444581a7b5906cae6973f5. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:45:53.222901 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8cd52f95-d829-4c8c-a119-b19d042286ae tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.210150 Sep 13 06:45:53.223443 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 406/798] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Sep 13 06:45:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 211 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 06:45:55.054281 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1485504187", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9076b3a-14f3-4a19-ae8d-eede5ca457d3"}], "security_groups": [{"name": "tempest-securitygroup--2062274281"}], "key_name": "tempest-keypair-992770201", "user_data": "}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:45:55.065945 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=4 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:55.066820 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:55.182589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] validate_networks() for [('f9076b3a-14f3-4a19-ae8d-eede5ca457d3', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:45:55.642131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:45:55.642557 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:45:55.643033 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:45:55.643475 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:45:55.643883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:45:55.655103 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:55.655870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:55.657080 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:55.658008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:55.658761 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:55.659337 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:55.685684 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Getting quotas for project 1a77de8686444581a7b5906cae6973f5. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:45:55.690673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Getting quotas for user 6b89305abaa14207b2840164c1a90e7b and project 1a77de8686444581a7b5906cae6973f5. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:45:55.704524 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:45:55.707314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:45:55.764856 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8fa23eb0-64ff-452a-9257-392ed81321ea tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.720821 Sep 13 06:45:55.765916 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 393/799] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Sep 13 06:45:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 06:45:55.778709 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-94a95700-b317-40bd-a28b-1f58c78211ba tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:55.779347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-94a95700-b317-40bd-a28b-1f58c78211ba tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:55.782291 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:55.854432 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-94a95700-b317-40bd-a28b-1f58c78211ba tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:55.863976 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-94a95700-b317-40bd-a28b-1f58c78211ba tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:55.866261 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-94a95700-b317-40bd-a28b-1f58c78211ba tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:55.871022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-94a95700-b317-40bd-a28b-1f58c78211ba tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1281 microversion: 2.20 time: 0.093888 Sep 13 06:45:55.891640 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 407/800] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:45:55 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:45:56.900088 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:56.900979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:56.910977 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:56.911732 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:56.912375 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:56.913077 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:56.913926 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:56.914355 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:57.032385 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:57.054781 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:57.056668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:57.057927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-880a613f-5285-4351-8a98-b53df491e290 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1333 microversion: 2.20 time: 0.162602 Sep 13 06:45:57.059458 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 394/801] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:45:56 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1333 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:45:58.086204 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:58.087472 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:58.093767 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:58.095127 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:58.095594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:58.096297 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:58.096754 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:58.097178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:58.167627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:58.177596 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:58.179532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:58.180670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-57515e10-e561-4149-9e12-a385dc7ef396 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1339 microversion: 2.20 time: 0.099353 Sep 13 06:45:58.181459 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 408/802] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:45:58 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:45:59.206847 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:45:59.207720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:45:59.214399 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:59.215204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:59.215776 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:59.216900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:45:59.217461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:45:59.218202 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:45:59.789384 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:59.800874 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:59.803446 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:45:59.804899 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9de98c72-6b59-4e6f-ac40-1dd8d347cc4b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1407 microversion: 2.20 time: 0.602576 Sep 13 06:45:59.805602 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 395/803] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:45:59 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1407 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:46:00.354318 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-0dbb7074-a357-4126-a0f2-bddbce58877f req-17ec1ce5-7928-43fe-9a62-02725f82bc3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd984c2d-db41-44f6-9324-394602908a4b", "tag": "85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:00.368192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0dbb7074-a357-4126-a0f2-bddbce58877f req-17ec1ce5-7928-43fe-9a62-02725f82bc3f service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:00.368192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0dbb7074-a357-4126-a0f2-bddbce58877f req-17ec1ce5-7928-43fe-9a62-02725f82bc3f service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:00.368626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0dbb7074-a357-4126-a0f2-bddbce58877f req-17ec1ce5-7928-43fe-9a62-02725f82bc3f service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:00.382705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-0dbb7074-a357-4126-a0f2-bddbce58877f req-17ec1ce5-7928-43fe-9a62-02725f82bc3f service nova] Creating event network-changed:85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b for instance fd984c2d-db41-44f6-9324-394602908a4b on hv-cinder-85638 Sep 13 06:46:00.388689 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-0dbb7074-a357-4126-a0f2-bddbce58877f req-17ec1ce5-7928-43fe-9a62-02725f82bc3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037938 Sep 13 06:46:00.389404 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 409/804] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:00.836091 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:00.836936 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:00.847917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:00.848772 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:00.849507 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:00.850457 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:00.851118 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:00.851764 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:01.167304 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:01.176547 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:01.177990 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:01.179103 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a09a3c67-be2d-4c91-bd9a-2495f336a719 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1407 microversion: 2.20 time: 0.347229 Sep 13 06:46:01.179699 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 396/805] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:46:00 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:46:02.205897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:02.206634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:02.213659 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:02.214152 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:02.214584 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:02.215453 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:02.215909 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:02.216502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:02.371875 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:02.381475 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:02.383399 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:02.384629 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-740dc41c-e1c7-4ce8-8858-e04a2c9b815d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1407 microversion: 2.20 time: 0.183456 Sep 13 06:46:02.385336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 410/806] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:46:02 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:46:03.415248 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:03.416771 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:03.427477 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:03.428513 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:03.429382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:03.430355 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:03.431425 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:03.432537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:03.652873 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:03.678345 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:03.682679 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:03.689015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6fe84768-69ff-4c70-93c7-058dbf8023c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1407 microversion: 2.20 time: 0.278970 Sep 13 06:46:03.689952 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 397/807] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:46:03 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:46:04.713848 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:04.715066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:04.721998 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:04.722768 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:04.723404 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:04.724280 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:04.724897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:04.725479 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:04.887292 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:04.899194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:04.901510 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:04.903062 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ef34dc66-8f1d-4b14-a258-651b37b324a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1407 microversion: 2.20 time: 0.193560 Sep 13 06:46:04.904263 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 411/808] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:46:04 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:46:05.938344 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:05.941040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:05.945563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:05.946333 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=6 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:05.954130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:05.955099 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:05.955221 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:05.956100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:05.956577 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:05.957126 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:06.163323 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:06.173264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:06.174722 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:06.176237 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3e7d13a9-ca72-4779-984c-d1352c84b018 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1407 microversion: 2.20 time: 0.251642 Sep 13 06:46:06.176816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 398/809] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:46:05 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:46:07.107202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=6 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:07.202397 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:07.203669 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:07.212547 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:07.213295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:07.214034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:07.216334 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:07.217169 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:07.217604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:07.338108 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7783555f-e32c-47ca-b727-526b375a4bcf tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Action: 'create', calling method: .version_select at 0x7fdc0d4280d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1019875465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPZRI7wefkzm/YIei0w5s+1lv7Mxogfk7D/1559Rj+bS6YX+1CpjP7zwwnLRor6KTA9NSJzrO3Fzfp6jYRIymK7mo0vKzvUZdUl7ix7IkvHgWj0VUQqVDtVoGu5NW+nyA=="}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:07.358349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-7783555f-e32c-47ca-b727-526b375a4bcf tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Getting quotas for project 456f4a7236834a4985af1518a6884a5a. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:46:07.364163 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-7783555f-e32c-47ca-b727-526b375a4bcf tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Getting quotas for user 2742fc15584c4f0e87b8c30614efa877 and project 456f4a7236834a4985af1518a6884a5a. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:46:07.399809 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7783555f-e32c-47ca-b727-526b375a4bcf tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.297737 Sep 13 06:46:07.405977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 412/810] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Sep 13 06:46:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:07.422489 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-d3467e6d-1ce8-4b3b-bccd-ab8bc4f1c65b req-3a1a9389-e73a-44cd-9e3b-66ef9bd56e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd984c2d-db41-44f6-9324-394602908a4b", "name": "network-vif-plugged", "status": "completed", "tag": "85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:07.435256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:07.444024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:07.455511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:07.457182 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-037a04a0-c224-44aa-b46b-772e9290e9c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1407 microversion: 2.20 time: 0.258728 Sep 13 06:46:07.458125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 399/811] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:46:07 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:46:07.465625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-d3467e6d-1ce8-4b3b-bccd-ab8bc4f1c65b req-3a1a9389-e73a-44cd-9e3b-66ef9bd56e8e service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:07.466218 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-d3467e6d-1ce8-4b3b-bccd-ab8bc4f1c65b req-3a1a9389-e73a-44cd-9e3b-66ef9bd56e8e service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:07.466778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-d3467e6d-1ce8-4b3b-bccd-ab8bc4f1c65b req-3a1a9389-e73a-44cd-9e3b-66ef9bd56e8e service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:07.524412 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-d3467e6d-1ce8-4b3b-bccd-ab8bc4f1c65b req-3a1a9389-e73a-44cd-9e3b-66ef9bd56e8e service nova] Creating event network-vif-plugged:85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b for instance fd984c2d-db41-44f6-9324-394602908a4b on hv-cinder-85638 Sep 13 06:46:07.530439 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-d3467e6d-1ce8-4b3b-bccd-ab8bc4f1c65b req-3a1a9389-e73a-44cd-9e3b-66ef9bd56e8e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128426 Sep 13 06:46:07.532608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 413/812] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:08.486932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:08.487826 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:08.494210 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:08.495164 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:08.495703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:08.496469 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:08.496991 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:08.497483 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:08.678478 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:08.686763 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:08.688272 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:08.689423 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c5b9b4e2-0e0b-468f-9bc0-ab4e50f1725a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1407 microversion: 2.20 time: 0.206933 Sep 13 06:46:08.691559 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 400/813] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:46:08 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:46:09.714708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:09.715480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:09.717919 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:09.724435 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:09.724922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:09.725357 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:09.726054 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:09.726508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:09.726933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:09.863196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:09.871461 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:09.872922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:09.874096 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d9791a2d-7eb1-45bb-83fb-a1c18c0438b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1599 microversion: 2.20 time: 0.163760 Sep 13 06:46:09.874653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 414/814] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:46:09 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:46:09.899669 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e246a80f-934b-4a1a-8f66-dfbec25d927d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:09.900202 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e246a80f-934b-4a1a-8f66-dfbec25d927d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:09.906466 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e246a80f-934b-4a1a-8f66-dfbec25d927d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:09.906971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e246a80f-934b-4a1a-8f66-dfbec25d927d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:09.907429 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e246a80f-934b-4a1a-8f66-dfbec25d927d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:09.908122 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e246a80f-934b-4a1a-8f66-dfbec25d927d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:09.908577 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e246a80f-934b-4a1a-8f66-dfbec25d927d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:09.909003 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e246a80f-934b-4a1a-8f66-dfbec25d927d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:09.990489 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e246a80f-934b-4a1a-8f66-dfbec25d927d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091612 Sep 13 06:46:09.998985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 401/815] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Sep 13 06:46:09 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:46:10.955031 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-0c26c73f-38fb-4354-9c30-1f1240f35631 req-9b671f8c-8cfc-4698-a91f-27cd0d887eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd984c2d-db41-44f6-9324-394602908a4b", "tag": "85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:10.965545 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0c26c73f-38fb-4354-9c30-1f1240f35631 req-9b671f8c-8cfc-4698-a91f-27cd0d887eab service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:10.966065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0c26c73f-38fb-4354-9c30-1f1240f35631 req-9b671f8c-8cfc-4698-a91f-27cd0d887eab service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:10.966523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0c26c73f-38fb-4354-9c30-1f1240f35631 req-9b671f8c-8cfc-4698-a91f-27cd0d887eab service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:10.978611 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-0c26c73f-38fb-4354-9c30-1f1240f35631 req-9b671f8c-8cfc-4698-a91f-27cd0d887eab service nova] Creating event network-changed:85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b for instance fd984c2d-db41-44f6-9324-394602908a4b on hv-cinder-85638 Sep 13 06:46:10.984338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-0c26c73f-38fb-4354-9c30-1f1240f35631 req-9b671f8c-8cfc-4698-a91f-27cd0d887eab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032941 Sep 13 06:46:10.985427 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 415/816] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:12.035989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f521efa0-5ad4-4875-a1a8-ec0f2a5157da tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:12.036569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f521efa0-5ad4-4875-a1a8-ec0f2a5157da tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:12.042705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f521efa0-5ad4-4875-a1a8-ec0f2a5157da tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:12.043345 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f521efa0-5ad4-4875-a1a8-ec0f2a5157da tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:12.043824 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f521efa0-5ad4-4875-a1a8-ec0f2a5157da tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:12.044539 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f521efa0-5ad4-4875-a1a8-ec0f2a5157da tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:12.045204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f521efa0-5ad4-4875-a1a8-ec0f2a5157da tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:12.045650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f521efa0-5ad4-4875-a1a8-ec0f2a5157da tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:12.072587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f521efa0-5ad4-4875-a1a8-ec0f2a5157da tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/ips" status: 200 len: 150 microversion: 2.1 time: 0.041775 Sep 13 06:46:12.073076 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 402/817] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Sep 13 06:46:12 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:13.470801 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-40c7734e-bc79-4a9f-ad6a-72dc3fd981f0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "350f52bf-2331-4138-97a7-c530e09eb229"}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:13.473222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-40c7734e-bc79-4a9f-ad6a-72dc3fd981f0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:13.479242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40c7734e-bc79-4a9f-ad6a-72dc3fd981f0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:13.479753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40c7734e-bc79-4a9f-ad6a-72dc3fd981f0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:13.480182 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40c7734e-bc79-4a9f-ad6a-72dc3fd981f0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:13.480866 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40c7734e-bc79-4a9f-ad6a-72dc3fd981f0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:13.481314 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40c7734e-bc79-4a9f-ad6a-72dc3fd981f0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:13.481738 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-40c7734e-bc79-4a9f-ad6a-72dc3fd981f0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:13.772819 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-40c7734e-bc79-4a9f-ad6a-72dc3fd981f0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306955 Sep 13 06:46:13.773791 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 416/818] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:46:13 2022] POST /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:21.324660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "350f52bf-2331-4138-97a7-c530e09eb229"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:21.327040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:21.334577 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:21.335064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:21.335530 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:21.336214 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:21.336656 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:21.337080 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:21.418865 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Invalid volume: volume 350f52bf-2331-4138-97a7-c530e09eb229 is already attached to instances: 4531b7bb-f851-4652-8ae1-c60a44937f2a Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: POST /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments HTTP/1.1 Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 74 Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:46:21.420633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {"volumeAttachment": {"volumeId": "350f52bf-2331-4138-97a7-c530e09eb229"}} Sep 13 06:46:21.422291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Invalid volume: volume 350f52bf-2331-4138-97a7-c530e09eb229 is already attached to instances: 4531b7bb-f851-4652-8ae1-c60a44937f2a Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'server_id': '4531b7bb-f851-4652-8ae1-c60a44937f2a', 'body': {'volumeAttachment': {'volumeId': '350f52bf-2331-4138-97a7-c530e09eb229'}}} Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 350f52bf-2331-4138-97a7-c530e09eb229 is already attached to instances: 4531b7bb-f851-4652-8ae1-c60a44937f2a Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:46:21.423280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 350f52bf-2331-4138-97a7-c530e09eb229 is already attached to instances: 4531b7bb-f851-4652-8ae1-c60a44937f2a Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:46:21.424589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:46:21.426501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:46:21.426501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:46:21.426501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:46:21.426501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 350f52bf-2331-4138-97a7-c530e09eb229 is already attached to instances: 4531b7bb-f851-4652-8ae1-c60a44937f2a Sep 13 06:46:21.426501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:46:21.426501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 400 to user: Invalid volume: volume 350f52bf-2331-4138-97a7-c530e09eb229 is already attached to instances: 4531b7bb-f851-4652-8ae1-c60a44937f2a {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:46:21.426501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b1c410ba-e9f9-4681-bd90-aeb97e0702e3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101826 Sep 13 06:46:21.426501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 403/819] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:46:21 2022] POST /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 06:46:21.486189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=4 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:21.491302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a35c34e2-e934-4fc7-8f9c-b67c3b79652a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:21.491904 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a35c34e2-e934-4fc7-8f9c-b67c3b79652a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:21.498192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a35c34e2-e934-4fc7-8f9c-b67c3b79652a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:21.498668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a35c34e2-e934-4fc7-8f9c-b67c3b79652a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:21.499097 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a35c34e2-e934-4fc7-8f9c-b67c3b79652a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:21.499810 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a35c34e2-e934-4fc7-8f9c-b67c3b79652a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:21.500259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a35c34e2-e934-4fc7-8f9c-b67c3b79652a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:21.500674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a35c34e2-e934-4fc7-8f9c-b67c3b79652a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:21.583432 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.objects.instance [None req-a35c34e2-e934-4fc7-8f9c-b67c3b79652a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lazy-loading 'services' on Instance uuid 4531b7bb-f851-4652-8ae1-c60a44937f2a {{(pid=132399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:46:21.655100 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a35c34e2-e934-4fc7-8f9c-b67c3b79652a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments/350f52bf-2331-4138-97a7-c530e09eb229" status: 202 len: 0 microversion: 2.1 time: 0.169595 Sep 13 06:46:21.655731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 417/820] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:46:21 2022] DELETE /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments/350f52bf-2331-4138-97a7-c530e09eb229 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:46:21.664626 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1ed6ef34-be4f-4d95-9ab2-dcbb9c2c231d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:21.667049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1ed6ef34-be4f-4d95-9ab2-dcbb9c2c231d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:21.673429 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ed6ef34-be4f-4d95-9ab2-dcbb9c2c231d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:21.673913 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ed6ef34-be4f-4d95-9ab2-dcbb9c2c231d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:21.674360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ed6ef34-be4f-4d95-9ab2-dcbb9c2c231d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:21.675100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ed6ef34-be4f-4d95-9ab2-dcbb9c2c231d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:21.675548 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ed6ef34-be4f-4d95-9ab2-dcbb9c2c231d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:21.676467 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1ed6ef34-be4f-4d95-9ab2-dcbb9c2c231d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:21.707287 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1ed6ef34-be4f-4d95-9ab2-dcbb9c2c231d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Sep 13 06:46:21.707893 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 404/821] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:46:21 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:22.720440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-39e7e4e9-bebf-4a03-bca3-798d6282d582 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:22.722687 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-39e7e4e9-bebf-4a03-bca3-798d6282d582 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:22.729508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-39e7e4e9-bebf-4a03-bca3-798d6282d582 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:22.729979 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-39e7e4e9-bebf-4a03-bca3-798d6282d582 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:22.730401 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-39e7e4e9-bebf-4a03-bca3-798d6282d582 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:22.731079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-39e7e4e9-bebf-4a03-bca3-798d6282d582 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:22.731553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-39e7e4e9-bebf-4a03-bca3-798d6282d582 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:22.731970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-39e7e4e9-bebf-4a03-bca3-798d6282d582 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:22.761234 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-39e7e4e9-bebf-4a03-bca3-798d6282d582 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045231 Sep 13 06:46:22.761783 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 418/822] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:46:22 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:23.774475 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e5475f60-7045-40ac-a703-082c6beca1fd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:23.776647 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e5475f60-7045-40ac-a703-082c6beca1fd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:23.783152 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5475f60-7045-40ac-a703-082c6beca1fd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:23.783662 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5475f60-7045-40ac-a703-082c6beca1fd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:23.784101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5475f60-7045-40ac-a703-082c6beca1fd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:23.784790 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5475f60-7045-40ac-a703-082c6beca1fd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:23.785245 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5475f60-7045-40ac-a703-082c6beca1fd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:23.786314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e5475f60-7045-40ac-a703-082c6beca1fd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:23.814513 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e5475f60-7045-40ac-a703-082c6beca1fd tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044480 Sep 13 06:46:23.815061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 405/823] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:46:23 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 06:46:23.877167 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d5f067fb-c5cb-4304-a67b-a5434af8e0ac tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:23.877665 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d5f067fb-c5cb-4304-a67b-a5434af8e0ac tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:23.884001 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5f067fb-c5cb-4304-a67b-a5434af8e0ac tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:23.884483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5f067fb-c5cb-4304-a67b-a5434af8e0ac tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:23.884915 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5f067fb-c5cb-4304-a67b-a5434af8e0ac tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:23.885600 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5f067fb-c5cb-4304-a67b-a5434af8e0ac tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:23.886048 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5f067fb-c5cb-4304-a67b-a5434af8e0ac tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:23.886467 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5f067fb-c5cb-4304-a67b-a5434af8e0ac tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:23.911699 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d5f067fb-c5cb-4304-a67b-a5434af8e0ac tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:46:23.983992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d5f067fb-c5cb-4304-a67b-a5434af8e0ac tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 204 len: 0 microversion: 2.1 time: 0.110263 Sep 13 06:46:23.984570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 419/824] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:46:23 2022] DELETE /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:23.992717 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-db0f711c-e1c7-400c-b8f8-80cadee9ed21 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:23.993327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-db0f711c-e1c7-400c-b8f8-80cadee9ed21 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:23.999250 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-db0f711c-e1c7-400c-b8f8-80cadee9ed21 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:23.999644 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-db0f711c-e1c7-400c-b8f8-80cadee9ed21 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:24.000085 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-db0f711c-e1c7-400c-b8f8-80cadee9ed21 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:24.000786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-db0f711c-e1c7-400c-b8f8-80cadee9ed21 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:24.001299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-db0f711c-e1c7-400c-b8f8-80cadee9ed21 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:24.001728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-db0f711c-e1c7-400c-b8f8-80cadee9ed21 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:24.128829 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-db0f711c-e1c7-400c-b8f8-80cadee9ed21 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:24.137237 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-db0f711c-e1c7-400c-b8f8-80cadee9ed21 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1683 microversion: 2.1 time: 0.148450 Sep 13 06:46:24.137808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 406/825] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:23 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:25.161984 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9877cf5f-8a6e-4d68-aed4-e37d1f9bc10b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:25.162636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9877cf5f-8a6e-4d68-aed4-e37d1f9bc10b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:25.169222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9877cf5f-8a6e-4d68-aed4-e37d1f9bc10b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:25.169704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9877cf5f-8a6e-4d68-aed4-e37d1f9bc10b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:25.170137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9877cf5f-8a6e-4d68-aed4-e37d1f9bc10b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:25.170819 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9877cf5f-8a6e-4d68-aed4-e37d1f9bc10b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:25.171269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9877cf5f-8a6e-4d68-aed4-e37d1f9bc10b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:25.171720 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9877cf5f-8a6e-4d68-aed4-e37d1f9bc10b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:25.300681 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9877cf5f-8a6e-4d68-aed4-e37d1f9bc10b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:25.308316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9877cf5f-8a6e-4d68-aed4-e37d1f9bc10b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1683 microversion: 2.1 time: 0.151339 Sep 13 06:46:25.308879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 420/826] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:25 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:26.332910 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9bf35e10-a99c-4a1f-89a3-5aeaab013886 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:26.333515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9bf35e10-a99c-4a1f-89a3-5aeaab013886 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:26.335794 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:26.341438 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf35e10-a99c-4a1f-89a3-5aeaab013886 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:26.341942 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf35e10-a99c-4a1f-89a3-5aeaab013886 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:26.342369 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf35e10-a99c-4a1f-89a3-5aeaab013886 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:26.343045 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf35e10-a99c-4a1f-89a3-5aeaab013886 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:26.343519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf35e10-a99c-4a1f-89a3-5aeaab013886 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:26.343937 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf35e10-a99c-4a1f-89a3-5aeaab013886 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:26.346922 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=77 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:26.479559 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9bf35e10-a99c-4a1f-89a3-5aeaab013886 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:26.487145 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9bf35e10-a99c-4a1f-89a3-5aeaab013886 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1683 microversion: 2.1 time: 0.158175 Sep 13 06:46:26.487740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 407/827] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:26 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:27.391658 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-271529e9-1191-4448-9539-b6c19dab3b7c req-6e0206fe-68fb-4dd8-9976-cbd1c69bfa6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4531b7bb-f851-4652-8ae1-c60a44937f2a", "name": "network-vif-deleted", "tag": "43b1e076-8ca9-454c-9682-8fbb81d23f05"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:27.402130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-271529e9-1191-4448-9539-b6c19dab3b7c req-6e0206fe-68fb-4dd8-9976-cbd1c69bfa6a service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:27.402612 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-271529e9-1191-4448-9539-b6c19dab3b7c req-6e0206fe-68fb-4dd8-9976-cbd1c69bfa6a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:27.403065 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-271529e9-1191-4448-9539-b6c19dab3b7c req-6e0206fe-68fb-4dd8-9976-cbd1c69bfa6a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:27.406920 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:27.416334 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-271529e9-1191-4448-9539-b6c19dab3b7c req-6e0206fe-68fb-4dd8-9976-cbd1c69bfa6a service nova] Creating event network-vif-deleted:43b1e076-8ca9-454c-9682-8fbb81d23f05 for instance 4531b7bb-f851-4652-8ae1-c60a44937f2a on hv-cinder-85638 Sep 13 06:46:27.422454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-271529e9-1191-4448-9539-b6c19dab3b7c req-6e0206fe-68fb-4dd8-9976-cbd1c69bfa6a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034358 Sep 13 06:46:27.423110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 421/828] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:27.510754 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:27.513560 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:27.527828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:27.528184 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:27.528800 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:27.529956 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:27.530482 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:27.530970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:27.572269 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:27.572993 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:27.573598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:27.574216 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lazy-loading 'fault' on Instance uuid 4531b7bb-f851-4652-8ae1-c60a44937f2a {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:46:27.637159 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:27.647062 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2535ac00-4246-47dc-b09f-8a4f0e9db574 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 200 len: 1332 microversion: 2.1 time: 0.140094 Sep 13 06:46:27.647675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 408/829] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:27 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 1332 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:28.671315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:28.671975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:28.678367 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:28.678845 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:28.679284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:28.679996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:28.680451 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:28.680874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:28.694129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a HTTP/1.1 Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:46:28.695760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:46:28.697371 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '4531b7bb-f851-4652-8ae1-c60a44937f2a'} Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:46:28.698215 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:46:28.699518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:46:28.700671 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:46:28.700671 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ccda2b54-9ff4-4f1d-b8e0-9d04017ca4eb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 404 len: 111 microversion: 2.1 time: 0.030615 Sep 13 06:46:28.700671 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 422/830] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:28 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:46:28.705698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-611eb8ca-3082-4fad-a726-b8ab6edc724f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '.version_select at 0x7fdc0d3c3b80>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:28.724458 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-611eb8ca-3082-4fad-a726-b8ab6edc724f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970454711" status: 202 len: 0 microversion: 2.1 time: 0.022453 Sep 13 06:46:28.725014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 409/831] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Sep 13 06:46:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970454711 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 06:46:29.345194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9beed3d0-5874-4e0e-b5ac-4b6dcb35195c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: .version_select at 0x7fdc0d383a60>, body: {"keypair": {"name": "tempest-keypair-2032448362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ11rEnQ06x/BhujjMBwpFt2AUARjBTuYEbvamguWejOTzwTOwzU3nj2H7zvyPxNddEJOwBrWXJjrc1a1bgXxXDeqPb1SjPzLhAJVg3c60U65garNcwoPWWAidaHmXCeTw=="}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:29.361499 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-9beed3d0-5874-4e0e-b5ac-4b6dcb35195c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:46:29.370324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-9beed3d0-5874-4e0e-b5ac-4b6dcb35195c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for user cac2d22d853a4984b229911bde3a450b and project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:46:29.392170 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9beed3d0-5874-4e0e-b5ac-4b6dcb35195c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054559 Sep 13 06:46:29.392761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 423/832] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Sep 13 06:46:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:30.659375 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1695137147", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "490d7309-ad3e-4bc6-9625-e6996e2b80d7"}], "security_groups": [{"name": "tempest-securitygroup--665984710"}], "key_name": "tempest-keypair-2032448362", "user_data": "}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:30.764432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] validate_networks() for [('490d7309-ad3e-4bc6-9625-e6996e2b80d7', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:46:31.135863 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:46:31.136293 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:46:31.136798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:46:31.137213 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:46:31.137969 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:46:31.147057 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:31.147590 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:31.148035 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:31.148796 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:31.149257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:31.149687 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:31.167520 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:46:31.171275 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Getting quotas for user cac2d22d853a4984b229911bde3a450b and project b763ebe3e21d4fc5a43f1af21362d401. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:46:31.181943 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:46:31.184105 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:46:31.233021 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8303cccf-4215-4574-8429-f0914ed7ab69 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.577422 Sep 13 06:46:31.239062 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 410/833] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:46:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:46:31.244712 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5aa21a6d-4827-4f50-9fe8-6cb1289234fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:31.245324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5aa21a6d-4827-4f50-9fe8-6cb1289234fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:31.301676 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5aa21a6d-4827-4f50-9fe8-6cb1289234fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:31.308437 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5aa21a6d-4827-4f50-9fe8-6cb1289234fb tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1242 microversion: 2.1 time: 0.068125 Sep 13 06:46:31.309070 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 424/834] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:31 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:32.335064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-dc50aae3-95db-4345-b9a1-24a0f56b186f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:32.335756 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-dc50aae3-95db-4345-b9a1-24a0f56b186f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:32.344585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc50aae3-95db-4345-b9a1-24a0f56b186f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:32.345265 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc50aae3-95db-4345-b9a1-24a0f56b186f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:32.345713 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc50aae3-95db-4345-b9a1-24a0f56b186f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:32.346432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc50aae3-95db-4345-b9a1-24a0f56b186f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:32.346892 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc50aae3-95db-4345-b9a1-24a0f56b186f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:32.347323 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dc50aae3-95db-4345-b9a1-24a0f56b186f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:32.413248 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dc50aae3-95db-4345-b9a1-24a0f56b186f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:32.420984 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-dc50aae3-95db-4345-b9a1-24a0f56b186f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1294 microversion: 2.1 time: 0.092340 Sep 13 06:46:32.421559 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 411/835] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:32 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:33.364195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1494379387", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1019875465", "security_groups": [{"name": "tempest-secgroup-smoke-46896824"}], "networks": [{"uuid": "a775ddd7-95f8-4aef-b9ef-89abb9112e5f"}], "block_device_mapping_v2": [{"uuid": "f016bd63-b993-4960-ad05-575af77db1a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:33.448672 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7d392cb9-b175-4ead-b93f-6ef6e3d424bf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:33.449891 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7d392cb9-b175-4ead-b93f-6ef6e3d424bf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:33.457073 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d392cb9-b175-4ead-b93f-6ef6e3d424bf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:33.458054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d392cb9-b175-4ead-b93f-6ef6e3d424bf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:33.458854 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d392cb9-b175-4ead-b93f-6ef6e3d424bf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:33.460105 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d392cb9-b175-4ead-b93f-6ef6e3d424bf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:33.460771 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d392cb9-b175-4ead-b93f-6ef6e3d424bf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:33.461410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7d392cb9-b175-4ead-b93f-6ef6e3d424bf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:33.505855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.network.neutron [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] validate_networks() for [('a775ddd7-95f8-4aef-b9ef-89abb9112e5f', None, None, None, None, None)] {{(pid=132399) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:46:33.663447 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7d392cb9-b175-4ead-b93f-6ef6e3d424bf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:33.672067 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7d392cb9-b175-4ead-b93f-6ef6e3d424bf tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.227525 Sep 13 06:46:33.673133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 412/836] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:33 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:33.911693 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Flavor limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:46:33.912334 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Image limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:46:33.914117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Flavor pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:46:33.914684 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Image pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:46:33.915721 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:46:33.927565 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:33.928277 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:33.928709 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:33.929444 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:33.929896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:33.930318 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:33.948651 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Getting quotas for project 456f4a7236834a4985af1518a6884a5a. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:46:33.953774 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Getting quotas for user 2742fc15584c4f0e87b8c30614efa877 and project 456f4a7236834a4985af1518a6884a5a. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:46:34.015172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Going to run 1 instances... {{(pid=132399) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:46:34.017397 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f016bd63-b993-4960-ad05-575af77db1a9',volume_size=None,volume_type=None)] {{(pid=132399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:46:34.172584 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-90afae29-01e2-40e0-819b-f98b5265407b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.812671 Sep 13 06:46:34.174001 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 425/837] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:46:33 2022] POST /compute/v2.1/servers => generated 404 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 06:46:34.184285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-876446ec-a6d6-4e11-b22c-72b9448371e3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:34.185132 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-876446ec-a6d6-4e11-b22c-72b9448371e3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:34.249862 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-876446ec-a6d6-4e11-b22c-72b9448371e3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:34.258021 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-876446ec-a6d6-4e11-b22c-72b9448371e3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1089 microversion: 2.1 time: 0.077524 Sep 13 06:46:34.258601 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 413/838] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:34 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:34.290867 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-dd07f470-195b-4783-ab85-4a1ef5c5e37a req-c0b9d8a0-9f37-43be-9e87-88f83dc44e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a787fe-2c12-4673-a5c5-deaf07aecbe5", "tag": "a22eab72-2623-4115-959c-236434d708e2"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:34.306066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-dd07f470-195b-4783-ab85-4a1ef5c5e37a req-c0b9d8a0-9f37-43be-9e87-88f83dc44e52 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:34.306742 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-dd07f470-195b-4783-ab85-4a1ef5c5e37a req-c0b9d8a0-9f37-43be-9e87-88f83dc44e52 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:34.307391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-dd07f470-195b-4783-ab85-4a1ef5c5e37a req-c0b9d8a0-9f37-43be-9e87-88f83dc44e52 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:34.320884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-dd07f470-195b-4783-ab85-4a1ef5c5e37a req-c0b9d8a0-9f37-43be-9e87-88f83dc44e52 service nova] Creating event network-changed:a22eab72-2623-4115-959c-236434d708e2 for instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 on hv-cinder-85638 Sep 13 06:46:34.326020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-dd07f470-195b-4783-ab85-4a1ef5c5e37a req-c0b9d8a0-9f37-43be-9e87-88f83dc44e52 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040391 Sep 13 06:46:34.327636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 426/839] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:46:34.700213 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4169d0f4-f3b9-46a9-9bde-e9b6554e19ee tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:34.701489 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4169d0f4-f3b9-46a9-9bde-e9b6554e19ee tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:34.713025 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4169d0f4-f3b9-46a9-9bde-e9b6554e19ee tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:34.713889 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4169d0f4-f3b9-46a9-9bde-e9b6554e19ee tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:34.714611 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4169d0f4-f3b9-46a9-9bde-e9b6554e19ee tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:34.715799 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4169d0f4-f3b9-46a9-9bde-e9b6554e19ee tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:34.716581 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4169d0f4-f3b9-46a9-9bde-e9b6554e19ee tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:34.717326 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4169d0f4-f3b9-46a9-9bde-e9b6554e19ee tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:34.877123 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4169d0f4-f3b9-46a9-9bde-e9b6554e19ee tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:34.885392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4169d0f4-f3b9-46a9-9bde-e9b6554e19ee tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.192585 Sep 13 06:46:34.885955 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 414/840] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:34 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:35.282603 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e574e3d1-5f02-404a-b1cf-e47d373e971f tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:35.283303 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e574e3d1-5f02-404a-b1cf-e47d373e971f tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:35.290643 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e574e3d1-5f02-404a-b1cf-e47d373e971f tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:35.291119 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e574e3d1-5f02-404a-b1cf-e47d373e971f tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:35.291654 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e574e3d1-5f02-404a-b1cf-e47d373e971f tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:35.292333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e574e3d1-5f02-404a-b1cf-e47d373e971f tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:35.292782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e574e3d1-5f02-404a-b1cf-e47d373e971f tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:35.293197 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e574e3d1-5f02-404a-b1cf-e47d373e971f tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:35.358316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e574e3d1-5f02-404a-b1cf-e47d373e971f tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:35.366596 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e574e3d1-5f02-404a-b1cf-e47d373e971f tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1187 microversion: 2.1 time: 0.088489 Sep 13 06:46:35.367165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 427/841] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:35 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:35.908062 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-92f15e9d-f18d-4925-9cc6-596765b533a4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:35.908601 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-92f15e9d-f18d-4925-9cc6-596765b533a4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:35.915198 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-92f15e9d-f18d-4925-9cc6-596765b533a4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:35.915711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-92f15e9d-f18d-4925-9cc6-596765b533a4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:35.916148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-92f15e9d-f18d-4925-9cc6-596765b533a4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:35.916867 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-92f15e9d-f18d-4925-9cc6-596765b533a4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:35.917322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-92f15e9d-f18d-4925-9cc6-596765b533a4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:35.917746 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-92f15e9d-f18d-4925-9cc6-596765b533a4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:36.047225 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-92f15e9d-f18d-4925-9cc6-596765b533a4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:36.055598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-92f15e9d-f18d-4925-9cc6-596765b533a4 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.151457 Sep 13 06:46:36.056153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 415/842] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:35 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:36.389449 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ae793d1e-c439-45b8-b2e1-89a54582e8a1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:36.390056 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ae793d1e-c439-45b8-b2e1-89a54582e8a1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:36.396859 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae793d1e-c439-45b8-b2e1-89a54582e8a1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:36.397340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae793d1e-c439-45b8-b2e1-89a54582e8a1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:36.397769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae793d1e-c439-45b8-b2e1-89a54582e8a1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:36.398443 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae793d1e-c439-45b8-b2e1-89a54582e8a1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:36.398896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae793d1e-c439-45b8-b2e1-89a54582e8a1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:36.399316 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae793d1e-c439-45b8-b2e1-89a54582e8a1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:36.460008 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ae793d1e-c439-45b8-b2e1-89a54582e8a1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:36.467692 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ae793d1e-c439-45b8-b2e1-89a54582e8a1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1187 microversion: 2.1 time: 0.082024 Sep 13 06:46:36.468257 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 428/843] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:36 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:37.078152 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9b1c9cdd-7c2e-4dfb-a0c2-c23100c9e068 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:37.078678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9b1c9cdd-7c2e-4dfb-a0c2-c23100c9e068 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:37.085845 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b1c9cdd-7c2e-4dfb-a0c2-c23100c9e068 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:37.086327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b1c9cdd-7c2e-4dfb-a0c2-c23100c9e068 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:37.086762 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b1c9cdd-7c2e-4dfb-a0c2-c23100c9e068 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:37.087477 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b1c9cdd-7c2e-4dfb-a0c2-c23100c9e068 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:37.087935 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b1c9cdd-7c2e-4dfb-a0c2-c23100c9e068 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:37.088360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b1c9cdd-7c2e-4dfb-a0c2-c23100c9e068 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:37.215840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9b1c9cdd-7c2e-4dfb-a0c2-c23100c9e068 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:37.223279 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9b1c9cdd-7c2e-4dfb-a0c2-c23100c9e068 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.149075 Sep 13 06:46:37.223870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 416/844] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:37 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:37.491342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-06ae7034-42b2-476d-b8a1-745040a6482e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:37.491981 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-06ae7034-42b2-476d-b8a1-745040a6482e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:37.498157 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06ae7034-42b2-476d-b8a1-745040a6482e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:37.499168 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06ae7034-42b2-476d-b8a1-745040a6482e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:37.499624 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06ae7034-42b2-476d-b8a1-745040a6482e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:37.500322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06ae7034-42b2-476d-b8a1-745040a6482e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:37.500778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06ae7034-42b2-476d-b8a1-745040a6482e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:37.501202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06ae7034-42b2-476d-b8a1-745040a6482e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:37.561603 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-06ae7034-42b2-476d-b8a1-745040a6482e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:37.569657 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-06ae7034-42b2-476d-b8a1-745040a6482e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1187 microversion: 2.1 time: 0.082903 Sep 13 06:46:37.570229 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 429/845] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:37 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:38.246265 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-64a4f8ae-07e7-4a9f-88ae-56e69d8a2446 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:38.246879 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-64a4f8ae-07e7-4a9f-88ae-56e69d8a2446 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:38.253415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-64a4f8ae-07e7-4a9f-88ae-56e69d8a2446 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:38.253970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-64a4f8ae-07e7-4a9f-88ae-56e69d8a2446 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:38.254411 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-64a4f8ae-07e7-4a9f-88ae-56e69d8a2446 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:38.255130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-64a4f8ae-07e7-4a9f-88ae-56e69d8a2446 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:38.255614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-64a4f8ae-07e7-4a9f-88ae-56e69d8a2446 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:38.256037 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-64a4f8ae-07e7-4a9f-88ae-56e69d8a2446 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:38.602478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bcd975fe-0b96-4a53-8374-6c0946f97bed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:38.610743 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-bcd975fe-0b96-4a53-8374-6c0946f97bed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:38.618559 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bcd975fe-0b96-4a53-8374-6c0946f97bed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:38.619268 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bcd975fe-0b96-4a53-8374-6c0946f97bed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:38.619882 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bcd975fe-0b96-4a53-8374-6c0946f97bed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:38.620840 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bcd975fe-0b96-4a53-8374-6c0946f97bed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:38.621477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bcd975fe-0b96-4a53-8374-6c0946f97bed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:38.622301 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bcd975fe-0b96-4a53-8374-6c0946f97bed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:38.694835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-64a4f8ae-07e7-4a9f-88ae-56e69d8a2446 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:38.703440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-bcd975fe-0b96-4a53-8374-6c0946f97bed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:38.714399 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-bcd975fe-0b96-4a53-8374-6c0946f97bed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1205 microversion: 2.1 time: 0.125373 Sep 13 06:46:38.715060 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 430/846] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:38 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1205 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:38.721242 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-64a4f8ae-07e7-4a9f-88ae-56e69d8a2446 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.478702 Sep 13 06:46:38.738317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 417/847] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:38 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:39.741782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-32af40e3-a244-48bb-b09c-d293b9deeb6b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:39.742393 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-32af40e3-a244-48bb-b09c-d293b9deeb6b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:39.744698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5211b0c4-7f75-4e7f-a77a-390e46b24923 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:39.745133 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:39.745308 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5211b0c4-7f75-4e7f-a77a-390e46b24923 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:39.750399 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-32af40e3-a244-48bb-b09c-d293b9deeb6b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:39.750878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-32af40e3-a244-48bb-b09c-d293b9deeb6b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:39.751301 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-32af40e3-a244-48bb-b09c-d293b9deeb6b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:39.751965 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5211b0c4-7f75-4e7f-a77a-390e46b24923 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:39.752097 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-32af40e3-a244-48bb-b09c-d293b9deeb6b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:39.752450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5211b0c4-7f75-4e7f-a77a-390e46b24923 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:39.752564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-32af40e3-a244-48bb-b09c-d293b9deeb6b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:39.752860 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-32af40e3-a244-48bb-b09c-d293b9deeb6b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:39.752960 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5211b0c4-7f75-4e7f-a77a-390e46b24923 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:39.753615 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5211b0c4-7f75-4e7f-a77a-390e46b24923 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:39.754162 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5211b0c4-7f75-4e7f-a77a-390e46b24923 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:39.754707 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5211b0c4-7f75-4e7f-a77a-390e46b24923 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:39.882825 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5211b0c4-7f75-4e7f-a77a-390e46b24923 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:39.887842 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-32af40e3-a244-48bb-b09c-d293b9deeb6b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:39.890924 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5211b0c4-7f75-4e7f-a77a-390e46b24923 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.149907 Sep 13 06:46:39.891526 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 418/848] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:39 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:46:39.896138 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-32af40e3-a244-48bb-b09c-d293b9deeb6b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.158763 Sep 13 06:46:39.896704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 431/849] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:39 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:40.913593 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d852795d-b65e-4b6e-b842-50525d2c0ccc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:40.914128 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d852795d-b65e-4b6e-b842-50525d2c0ccc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:40.919133 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b37b1746-f74b-437d-933c-57dd657dccf5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:40.919844 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b37b1746-f74b-437d-933c-57dd657dccf5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:40.920534 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d852795d-b65e-4b6e-b842-50525d2c0ccc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:40.921023 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d852795d-b65e-4b6e-b842-50525d2c0ccc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:40.921580 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d852795d-b65e-4b6e-b842-50525d2c0ccc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:40.922284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d852795d-b65e-4b6e-b842-50525d2c0ccc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:40.922740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d852795d-b65e-4b6e-b842-50525d2c0ccc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:40.923180 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d852795d-b65e-4b6e-b842-50525d2c0ccc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:40.926676 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b37b1746-f74b-437d-933c-57dd657dccf5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:40.927156 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b37b1746-f74b-437d-933c-57dd657dccf5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:40.927618 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b37b1746-f74b-437d-933c-57dd657dccf5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:40.928317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b37b1746-f74b-437d-933c-57dd657dccf5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:40.928771 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b37b1746-f74b-437d-933c-57dd657dccf5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:40.929196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b37b1746-f74b-437d-933c-57dd657dccf5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:41.055168 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-d852795d-b65e-4b6e-b842-50525d2c0ccc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:41.060627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b37b1746-f74b-437d-933c-57dd657dccf5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:41.063381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d852795d-b65e-4b6e-b842-50525d2c0ccc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.153939 Sep 13 06:46:41.063964 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 419/850] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:40 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:41.071037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b37b1746-f74b-437d-933c-57dd657dccf5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.155634 Sep 13 06:46:41.071638 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 432/851] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:40 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:41.718865 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-c275ae49-f134-4596-96b4-954113d00dcc req-24d32101-e311-4a46-b02c-ba54bb984516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd6a470-5bbf-4d29-b5e2-860f8f7c551b", "tag": "35c33167-d432-4f8a-b748-145b6562d972"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:41.724259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:41.729947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-c275ae49-f134-4596-96b4-954113d00dcc req-24d32101-e311-4a46-b02c-ba54bb984516 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:41.730421 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-c275ae49-f134-4596-96b4-954113d00dcc req-24d32101-e311-4a46-b02c-ba54bb984516 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:41.730846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-c275ae49-f134-4596-96b4-954113d00dcc req-24d32101-e311-4a46-b02c-ba54bb984516 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:41.741257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-c275ae49-f134-4596-96b4-954113d00dcc req-24d32101-e311-4a46-b02c-ba54bb984516 service nova] Creating event network-changed:35c33167-d432-4f8a-b748-145b6562d972 for instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b on hv-cinder-85638 Sep 13 06:46:41.746265 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-c275ae49-f134-4596-96b4-954113d00dcc req-24d32101-e311-4a46-b02c-ba54bb984516 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030967 Sep 13 06:46:41.746852 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 420/852] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:46:42.086634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e15dcf87-554d-428a-8e5c-7c7e68c203e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:42.087223 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e15dcf87-554d-428a-8e5c-7c7e68c203e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:42.093620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e15dcf87-554d-428a-8e5c-7c7e68c203e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:42.093873 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c6980e81-4344-4cb8-bc18-65f6bbf5d6cb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:42.094269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e15dcf87-554d-428a-8e5c-7c7e68c203e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:42.094514 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e15dcf87-554d-428a-8e5c-7c7e68c203e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:42.094618 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c6980e81-4344-4cb8-bc18-65f6bbf5d6cb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:42.095202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e15dcf87-554d-428a-8e5c-7c7e68c203e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:42.095697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e15dcf87-554d-428a-8e5c-7c7e68c203e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:42.096105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e15dcf87-554d-428a-8e5c-7c7e68c203e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:42.101133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6980e81-4344-4cb8-bc18-65f6bbf5d6cb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:42.101637 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6980e81-4344-4cb8-bc18-65f6bbf5d6cb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:42.102066 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6980e81-4344-4cb8-bc18-65f6bbf5d6cb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:42.102772 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6980e81-4344-4cb8-bc18-65f6bbf5d6cb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:42.103221 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6980e81-4344-4cb8-bc18-65f6bbf5d6cb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:42.103667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6980e81-4344-4cb8-bc18-65f6bbf5d6cb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:42.225437 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e15dcf87-554d-428a-8e5c-7c7e68c203e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:42.233178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e15dcf87-554d-428a-8e5c-7c7e68c203e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.150301 Sep 13 06:46:42.233746 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 433/853] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:42 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:42.237029 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c6980e81-4344-4cb8-bc18-65f6bbf5d6cb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:42.245348 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c6980e81-4344-4cb8-bc18-65f6bbf5d6cb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.155991 Sep 13 06:46:42.245896 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 421/854] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:42 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:46:43.256898 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-70e45d04-57e8-47fc-82a9-5377cf529f22 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:43.257504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-70e45d04-57e8-47fc-82a9-5377cf529f22 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:43.268090 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-cb56bbbb-e7b2-4384-b459-f2a3e25e4ee7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:43.268703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-cb56bbbb-e7b2-4384-b459-f2a3e25e4ee7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:43.274978 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb56bbbb-e7b2-4384-b459-f2a3e25e4ee7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:43.275559 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb56bbbb-e7b2-4384-b459-f2a3e25e4ee7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:43.275994 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb56bbbb-e7b2-4384-b459-f2a3e25e4ee7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:43.276692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb56bbbb-e7b2-4384-b459-f2a3e25e4ee7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:43.277142 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb56bbbb-e7b2-4384-b459-f2a3e25e4ee7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:43.278087 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cb56bbbb-e7b2-4384-b459-f2a3e25e4ee7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:43.280320 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70e45d04-57e8-47fc-82a9-5377cf529f22 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:43.280809 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70e45d04-57e8-47fc-82a9-5377cf529f22 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:43.281768 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70e45d04-57e8-47fc-82a9-5377cf529f22 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:43.282474 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70e45d04-57e8-47fc-82a9-5377cf529f22 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:43.282922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70e45d04-57e8-47fc-82a9-5377cf529f22 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:43.283338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-70e45d04-57e8-47fc-82a9-5377cf529f22 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:43.422263 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-70e45d04-57e8-47fc-82a9-5377cf529f22 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:43.423598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-cb56bbbb-e7b2-4384-b459-f2a3e25e4ee7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:43.430471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-70e45d04-57e8-47fc-82a9-5377cf529f22 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.177984 Sep 13 06:46:43.431040 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 434/855] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:43 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:43.431984 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-cb56bbbb-e7b2-4384-b459-f2a3e25e4ee7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.167673 Sep 13 06:46:43.432552 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 422/856] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:43 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:44.454248 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6f2fbd12-10bd-4659-aa31-473526d0660c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:44.454772 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6f2fbd12-10bd-4659-aa31-473526d0660c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:44.457019 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b9fa3ed2-d972-48f4-96f8-73fb58d6e29b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:44.457448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:44.457697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b9fa3ed2-d972-48f4-96f8-73fb58d6e29b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:44.458089 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=12 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:44.463537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f2fbd12-10bd-4659-aa31-473526d0660c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:44.464036 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f2fbd12-10bd-4659-aa31-473526d0660c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:44.464276 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=8 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:44.464492 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f2fbd12-10bd-4659-aa31-473526d0660c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:44.465458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f2fbd12-10bd-4659-aa31-473526d0660c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:44.465925 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f2fbd12-10bd-4659-aa31-473526d0660c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:44.466455 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f2fbd12-10bd-4659-aa31-473526d0660c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:44.472672 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b9fa3ed2-d972-48f4-96f8-73fb58d6e29b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:44.473532 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b9fa3ed2-d972-48f4-96f8-73fb58d6e29b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:44.474255 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b9fa3ed2-d972-48f4-96f8-73fb58d6e29b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:44.475062 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b9fa3ed2-d972-48f4-96f8-73fb58d6e29b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:44.475551 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b9fa3ed2-d972-48f4-96f8-73fb58d6e29b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:44.475983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b9fa3ed2-d972-48f4-96f8-73fb58d6e29b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:44.600194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6f2fbd12-10bd-4659-aa31-473526d0660c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:44.607816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6f2fbd12-10bd-4659-aa31-473526d0660c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.157515 Sep 13 06:46:44.608379 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 435/857] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:44 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:44.608486 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b9fa3ed2-d972-48f4-96f8-73fb58d6e29b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:44.616765 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b9fa3ed2-d972-48f4-96f8-73fb58d6e29b tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.165288 Sep 13 06:46:44.617329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 423/858] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:44 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:45.105132 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-53252327-1e65-4da1-a3c4-0483858bca7f req-bf562324-3948-4efa-86fd-4b4dce18aabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a787fe-2c12-4673-a5c5-deaf07aecbe5", "name": "network-vif-plugged", "status": "completed", "tag": "a22eab72-2623-4115-959c-236434d708e2"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:45.115512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-53252327-1e65-4da1-a3c4-0483858bca7f req-bf562324-3948-4efa-86fd-4b4dce18aabe service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:45.115991 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-53252327-1e65-4da1-a3c4-0483858bca7f req-bf562324-3948-4efa-86fd-4b4dce18aabe service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:45.116417 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-53252327-1e65-4da1-a3c4-0483858bca7f req-bf562324-3948-4efa-86fd-4b4dce18aabe service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:45.127435 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-53252327-1e65-4da1-a3c4-0483858bca7f req-bf562324-3948-4efa-86fd-4b4dce18aabe service nova] Creating event network-vif-plugged:a22eab72-2623-4115-959c-236434d708e2 for instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 on hv-cinder-85638 Sep 13 06:46:45.132171 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-53252327-1e65-4da1-a3c4-0483858bca7f req-bf562324-3948-4efa-86fd-4b4dce18aabe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032228 Sep 13 06:46:45.132757 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 436/859] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:45.630419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f48215b0-b872-4bf4-b65a-60836e0c6915 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:45.631025 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f48215b0-b872-4bf4-b65a-60836e0c6915 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:45.637679 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f48215b0-b872-4bf4-b65a-60836e0c6915 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:45.638230 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f48215b0-b872-4bf4-b65a-60836e0c6915 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:45.638668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f48215b0-b872-4bf4-b65a-60836e0c6915 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:45.639382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f48215b0-b872-4bf4-b65a-60836e0c6915 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:45.639839 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f48215b0-b872-4bf4-b65a-60836e0c6915 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:45.640312 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f48215b0-b872-4bf4-b65a-60836e0c6915 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:45.640595 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3137c97d-27f0-4405-8894-667c13920352 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:45.641282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3137c97d-27f0-4405-8894-667c13920352 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:45.647866 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3137c97d-27f0-4405-8894-667c13920352 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:45.648347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3137c97d-27f0-4405-8894-667c13920352 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:45.648771 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3137c97d-27f0-4405-8894-667c13920352 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:45.649454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3137c97d-27f0-4405-8894-667c13920352 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:45.649902 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3137c97d-27f0-4405-8894-667c13920352 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:45.650317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3137c97d-27f0-4405-8894-667c13920352 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:45.771949 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f48215b0-b872-4bf4-b65a-60836e0c6915 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:45.779634 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f48215b0-b872-4bf4-b65a-60836e0c6915 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.153033 Sep 13 06:46:45.780205 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 424/860] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:45 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:45.785126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3137c97d-27f0-4405-8894-667c13920352 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:45.792962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3137c97d-27f0-4405-8894-667c13920352 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.156959 Sep 13 06:46:45.793512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 437/861] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:45 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:46:46.803122 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9bf5492a-9793-459a-8fa4-4ba68bf232a8 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:46.803680 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9bf5492a-9793-459a-8fa4-4ba68bf232a8 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:46.809980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf5492a-9793-459a-8fa4-4ba68bf232a8 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:46.810464 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf5492a-9793-459a-8fa4-4ba68bf232a8 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:46.810890 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf5492a-9793-459a-8fa4-4ba68bf232a8 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:46.811601 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf5492a-9793-459a-8fa4-4ba68bf232a8 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:46.812054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf5492a-9793-459a-8fa4-4ba68bf232a8 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:46.812471 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9bf5492a-9793-459a-8fa4-4ba68bf232a8 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:46.815459 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6f90a8d0-2e1f-4bc9-8ef6-01ee5c953b9a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:46.816464 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6f90a8d0-2e1f-4bc9-8ef6-01ee5c953b9a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:46.822281 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f90a8d0-2e1f-4bc9-8ef6-01ee5c953b9a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:46.822757 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f90a8d0-2e1f-4bc9-8ef6-01ee5c953b9a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:46.823183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f90a8d0-2e1f-4bc9-8ef6-01ee5c953b9a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:46.823892 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f90a8d0-2e1f-4bc9-8ef6-01ee5c953b9a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:46.824343 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f90a8d0-2e1f-4bc9-8ef6-01ee5c953b9a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:46.824758 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6f90a8d0-2e1f-4bc9-8ef6-01ee5c953b9a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:46.942813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9bf5492a-9793-459a-8fa4-4ba68bf232a8 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:46.950536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9bf5492a-9793-459a-8fa4-4ba68bf232a8 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.151921 Sep 13 06:46:46.951107 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 425/862] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:46 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:46.951568 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6f90a8d0-2e1f-4bc9-8ef6-01ee5c953b9a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:46.959648 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6f90a8d0-2e1f-4bc9-8ef6-01ee5c953b9a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1367 microversion: 2.1 time: 0.148068 Sep 13 06:46:46.960202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 438/863] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:46 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:46:47.974069 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-071f5c1b-8fa2-447e-8f73-3f8fb234e71c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:47.974842 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-071f5c1b-8fa2-447e-8f73-3f8fb234e71c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:47.981184 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-071f5c1b-8fa2-447e-8f73-3f8fb234e71c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:47.981678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-071f5c1b-8fa2-447e-8f73-3f8fb234e71c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:47.982117 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-071f5c1b-8fa2-447e-8f73-3f8fb234e71c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:47.982846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-071f5c1b-8fa2-447e-8f73-3f8fb234e71c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:47.983307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-071f5c1b-8fa2-447e-8f73-3f8fb234e71c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:47.983771 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-071f5c1b-8fa2-447e-8f73-3f8fb234e71c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:47.985576 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-74fd6dcd-8e8b-450c-9ce7-6eefd2b930d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:47.986217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-74fd6dcd-8e8b-450c-9ce7-6eefd2b930d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:47.994106 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74fd6dcd-8e8b-450c-9ce7-6eefd2b930d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:47.994597 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74fd6dcd-8e8b-450c-9ce7-6eefd2b930d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:47.995030 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74fd6dcd-8e8b-450c-9ce7-6eefd2b930d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:47.995769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74fd6dcd-8e8b-450c-9ce7-6eefd2b930d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:47.996221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74fd6dcd-8e8b-450c-9ce7-6eefd2b930d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:47.996642 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74fd6dcd-8e8b-450c-9ce7-6eefd2b930d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:48.132984 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-74fd6dcd-8e8b-450c-9ce7-6eefd2b930d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:48.133154 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-071f5c1b-8fa2-447e-8f73-3f8fb234e71c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:48.135154 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:48.141154 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-74fd6dcd-8e8b-450c-9ce7-6eefd2b930d3 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1557 microversion: 2.1 time: 0.162094 Sep 13 06:46:48.141971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-071f5c1b-8fa2-447e-8f73-3f8fb234e71c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.172063 Sep 13 06:46:48.142114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 439/864] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:47 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:48.142765 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 426/865] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:47 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:48.163624 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-adf7ed7a-744d-4a04-9a67-e6929553fda7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:48.164117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-adf7ed7a-744d-4a04-9a67-e6929553fda7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:48.169914 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-adf7ed7a-744d-4a04-9a67-e6929553fda7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:48.170377 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-adf7ed7a-744d-4a04-9a67-e6929553fda7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:48.170812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-adf7ed7a-744d-4a04-9a67-e6929553fda7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:48.171540 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-adf7ed7a-744d-4a04-9a67-e6929553fda7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:48.171999 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-adf7ed7a-744d-4a04-9a67-e6929553fda7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:48.172422 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-adf7ed7a-744d-4a04-9a67-e6929553fda7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:48.248804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-adf7ed7a-744d-4a04-9a67-e6929553fda7 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089133 Sep 13 06:46:48.249403 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 440/866] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Sep 13 06:46:48 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:49.165916 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e7e39863-58ec-4b48-bdb1-f638747bfdba tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:49.166594 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e7e39863-58ec-4b48-bdb1-f638747bfdba tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:49.173458 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e7e39863-58ec-4b48-bdb1-f638747bfdba tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:49.173938 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e7e39863-58ec-4b48-bdb1-f638747bfdba tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:49.174370 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e7e39863-58ec-4b48-bdb1-f638747bfdba tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:49.175101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e7e39863-58ec-4b48-bdb1-f638747bfdba tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:49.175582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e7e39863-58ec-4b48-bdb1-f638747bfdba tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:49.176003 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e7e39863-58ec-4b48-bdb1-f638747bfdba tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:49.317968 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e7e39863-58ec-4b48-bdb1-f638747bfdba tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:49.326626 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e7e39863-58ec-4b48-bdb1-f638747bfdba tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.164562 Sep 13 06:46:49.327863 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 427/867] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:49 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:49.404873 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-1143cd23-4b68-4236-a752-d3d60edc0314 req-1888c248-0cd8-4dc7-abe8-5b5a4a27122e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a787fe-2c12-4673-a5c5-deaf07aecbe5", "tag": "a22eab72-2623-4115-959c-236434d708e2"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:49.417430 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-1143cd23-4b68-4236-a752-d3d60edc0314 req-1888c248-0cd8-4dc7-abe8-5b5a4a27122e service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:49.418175 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-1143cd23-4b68-4236-a752-d3d60edc0314 req-1888c248-0cd8-4dc7-abe8-5b5a4a27122e service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:49.418769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-1143cd23-4b68-4236-a752-d3d60edc0314 req-1888c248-0cd8-4dc7-abe8-5b5a4a27122e service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:49.429764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-1143cd23-4b68-4236-a752-d3d60edc0314 req-1888c248-0cd8-4dc7-abe8-5b5a4a27122e service nova] Creating event network-changed:a22eab72-2623-4115-959c-236434d708e2 for instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 on hv-cinder-85638 Sep 13 06:46:49.434590 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-1143cd23-4b68-4236-a752-d3d60edc0314 req-1888c248-0cd8-4dc7-abe8-5b5a4a27122e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034431 Sep 13 06:46:49.435734 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 441/868] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:49.448832 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-630858823", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-621610664", "security_groups": [{"name": "tempest-secgroup-smoke-209540783"}], "block_device_mapping_v2": [{"uuid": "7acfb49e-b8ed-4fbd-8317-6eda09be9363", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1bd1c3af-b1e3-4524-bee7-4fb25240d8e3"}]}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:49.618800 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] validate_networks() for [('1bd1c3af-b1e3-4524-bee7-4fb25240d8e3', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:46:50.073910 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:46:50.074341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:46:50.074903 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:46:50.075321 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:46:50.075782 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:46:50.085268 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:50.085989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:50.086497 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:50.087457 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:50.087942 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:50.088442 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:50.107212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Getting quotas for project 5d92a2cc741d45aba5ac112718389c22. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:46:50.111398 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Getting quotas for user ca7cb5590aff4b0283cd583b391a5ffe and project 5d92a2cc741d45aba5ac112718389c22. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:46:50.170948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:46:50.173168 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7acfb49e-b8ed-4fbd-8317-6eda09be9363',volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:46:50.309028 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1a9948b4-2995-4523-b693-2f9109d9f6bc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.864016 Sep 13 06:46:50.309913 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 428/869] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:46:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:46:50.325211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-76b3b015-3f11-4240-a6be-65f56b511274 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:50.326163 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-76b3b015-3f11-4240-a6be-65f56b511274 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:50.350701 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-17f27c70-25db-4540-952c-13890acbfbed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:50.351324 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-17f27c70-25db-4540-952c-13890acbfbed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:50.358669 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17f27c70-25db-4540-952c-13890acbfbed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:50.360016 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17f27c70-25db-4540-952c-13890acbfbed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:50.360614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17f27c70-25db-4540-952c-13890acbfbed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:50.361542 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17f27c70-25db-4540-952c-13890acbfbed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:50.362158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17f27c70-25db-4540-952c-13890acbfbed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:50.363884 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17f27c70-25db-4540-952c-13890acbfbed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:50.386360 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-76b3b015-3f11-4240-a6be-65f56b511274 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:50.393345 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-76b3b015-3f11-4240-a6be-65f56b511274 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1093 microversion: 2.1 time: 0.075979 Sep 13 06:46:50.399881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 442/870] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:50 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1093 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:50.511939 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-17f27c70-25db-4540-952c-13890acbfbed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:50.519629 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-17f27c70-25db-4540-952c-13890acbfbed tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.173376 Sep 13 06:46:50.521201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 429/871] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:50 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:46:51.417392 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7735d39a-1d10-48bc-a8d7-411777a228ba tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:51.417995 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7735d39a-1d10-48bc-a8d7-411777a228ba tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:51.424588 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7735d39a-1d10-48bc-a8d7-411777a228ba tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:51.425614 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7735d39a-1d10-48bc-a8d7-411777a228ba tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:51.426046 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7735d39a-1d10-48bc-a8d7-411777a228ba tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:51.426725 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7735d39a-1d10-48bc-a8d7-411777a228ba tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:51.427172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7735d39a-1d10-48bc-a8d7-411777a228ba tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:51.427619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7735d39a-1d10-48bc-a8d7-411777a228ba tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:51.488039 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7735d39a-1d10-48bc-a8d7-411777a228ba tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:51.495612 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7735d39a-1d10-48bc-a8d7-411777a228ba tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1191 microversion: 2.1 time: 0.081962 Sep 13 06:46:51.496172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 443/872] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:51 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:51.544000 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f14d9c3e-c187-4bd3-bbef-1f7d93cfaf83 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:51.544542 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f14d9c3e-c187-4bd3-bbef-1f7d93cfaf83 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:51.551460 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f14d9c3e-c187-4bd3-bbef-1f7d93cfaf83 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:51.551949 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f14d9c3e-c187-4bd3-bbef-1f7d93cfaf83 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:51.552383 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f14d9c3e-c187-4bd3-bbef-1f7d93cfaf83 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:51.553071 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f14d9c3e-c187-4bd3-bbef-1f7d93cfaf83 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:51.553527 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f14d9c3e-c187-4bd3-bbef-1f7d93cfaf83 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:51.553951 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f14d9c3e-c187-4bd3-bbef-1f7d93cfaf83 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:51.687734 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f14d9c3e-c187-4bd3-bbef-1f7d93cfaf83 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:51.696148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f14d9c3e-c187-4bd3-bbef-1f7d93cfaf83 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.156051 Sep 13 06:46:51.696712 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 430/873] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:51 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:52.522694 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-213d1d59-9470-4294-98c5-a1434b52ead7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:52.523295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-213d1d59-9470-4294-98c5-a1434b52ead7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:52.530914 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213d1d59-9470-4294-98c5-a1434b52ead7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:52.531773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213d1d59-9470-4294-98c5-a1434b52ead7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:52.532402 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213d1d59-9470-4294-98c5-a1434b52ead7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:52.533178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213d1d59-9470-4294-98c5-a1434b52ead7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:52.533628 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213d1d59-9470-4294-98c5-a1434b52ead7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:52.534252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-213d1d59-9470-4294-98c5-a1434b52ead7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:52.710091 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-213d1d59-9470-4294-98c5-a1434b52ead7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:52.723263 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-60a333cf-3f5c-455b-927c-a473f6752b85 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:52.724274 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-60a333cf-3f5c-455b-927c-a473f6752b85 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:52.732024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60a333cf-3f5c-455b-927c-a473f6752b85 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:52.732455 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60a333cf-3f5c-455b-927c-a473f6752b85 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:52.732941 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60a333cf-3f5c-455b-927c-a473f6752b85 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:52.733840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60a333cf-3f5c-455b-927c-a473f6752b85 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:52.734463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60a333cf-3f5c-455b-927c-a473f6752b85 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:52.735081 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-60a333cf-3f5c-455b-927c-a473f6752b85 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:52.750137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-213d1d59-9470-4294-98c5-a1434b52ead7 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1276 microversion: 2.1 time: 0.234435 Sep 13 06:46:52.750766 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 444/874] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:52 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1276 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:53.008232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-60a333cf-3f5c-455b-927c-a473f6752b85 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:53.016585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-60a333cf-3f5c-455b-927c-a473f6752b85 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.301690 Sep 13 06:46:53.017173 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 431/875] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:52 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:53.402274 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-6330f9b0-21b3-4953-934f-0fd0256f270e req-346b1049-62a0-4075-9a1d-0eacf26abfce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757cfd27-33d5-4139-adef-9d92d44795a7", "tag": "652aa8a2-ec94-42b2-8fc4-270bfe350fd4"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:53.413849 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-6330f9b0-21b3-4953-934f-0fd0256f270e req-346b1049-62a0-4075-9a1d-0eacf26abfce service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:53.415187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-6330f9b0-21b3-4953-934f-0fd0256f270e req-346b1049-62a0-4075-9a1d-0eacf26abfce service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:53.415613 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-6330f9b0-21b3-4953-934f-0fd0256f270e req-346b1049-62a0-4075-9a1d-0eacf26abfce service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:53.426781 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:53.429529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-6330f9b0-21b3-4953-934f-0fd0256f270e req-346b1049-62a0-4075-9a1d-0eacf26abfce service nova] Creating event network-changed:652aa8a2-ec94-42b2-8fc4-270bfe350fd4 for instance 757cfd27-33d5-4139-adef-9d92d44795a7 on hv-cinder-85638 Sep 13 06:46:53.434801 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-6330f9b0-21b3-4953-934f-0fd0256f270e req-346b1049-62a0-4075-9a1d-0eacf26abfce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036168 Sep 13 06:46:53.435707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 445/876] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:53.774667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-966dc019-b153-4393-bbbc-c2ca52415219 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:53.775433 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-966dc019-b153-4393-bbbc-c2ca52415219 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:53.781681 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-966dc019-b153-4393-bbbc-c2ca52415219 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:53.782203 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-966dc019-b153-4393-bbbc-c2ca52415219 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:53.782641 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-966dc019-b153-4393-bbbc-c2ca52415219 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:53.783346 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-966dc019-b153-4393-bbbc-c2ca52415219 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:53.783831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-966dc019-b153-4393-bbbc-c2ca52415219 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:53.784890 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-966dc019-b153-4393-bbbc-c2ca52415219 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:53.979847 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-966dc019-b153-4393-bbbc-c2ca52415219 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:53.988767 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-966dc019-b153-4393-bbbc-c2ca52415219 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.218069 Sep 13 06:46:53.996469 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 432/877] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:53 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:54.041497 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-df0f0488-7f50-431d-9910-bd0eb053bfb2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:54.042225 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-df0f0488-7f50-431d-9910-bd0eb053bfb2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:54.048401 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df0f0488-7f50-431d-9910-bd0eb053bfb2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:54.048890 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df0f0488-7f50-431d-9910-bd0eb053bfb2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:54.049324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df0f0488-7f50-431d-9910-bd0eb053bfb2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:54.050029 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df0f0488-7f50-431d-9910-bd0eb053bfb2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:54.050508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df0f0488-7f50-431d-9910-bd0eb053bfb2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:54.050933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df0f0488-7f50-431d-9910-bd0eb053bfb2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:54.182341 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-df0f0488-7f50-431d-9910-bd0eb053bfb2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:54.190111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-df0f0488-7f50-431d-9910-bd0eb053bfb2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.154153 Sep 13 06:46:54.191196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 446/878] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:54 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:55.012128 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-dd22442e-78ca-4eb9-b8f1-4aee9a19ab06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:55.012741 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-dd22442e-78ca-4eb9-b8f1-4aee9a19ab06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:55.019147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd22442e-78ca-4eb9-b8f1-4aee9a19ab06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:55.019669 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd22442e-78ca-4eb9-b8f1-4aee9a19ab06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:55.020110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd22442e-78ca-4eb9-b8f1-4aee9a19ab06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:55.020800 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd22442e-78ca-4eb9-b8f1-4aee9a19ab06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:55.021255 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd22442e-78ca-4eb9-b8f1-4aee9a19ab06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:55.021678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd22442e-78ca-4eb9-b8f1-4aee9a19ab06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:55.213989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b9eaaf60-1e0e-4f25-acba-ec88bf0dd847 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:55.214602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b9eaaf60-1e0e-4f25-acba-ec88bf0dd847 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:55.220724 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9eaaf60-1e0e-4f25-acba-ec88bf0dd847 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:55.221210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9eaaf60-1e0e-4f25-acba-ec88bf0dd847 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:55.222234 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9eaaf60-1e0e-4f25-acba-ec88bf0dd847 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:55.222929 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9eaaf60-1e0e-4f25-acba-ec88bf0dd847 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:55.223407 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9eaaf60-1e0e-4f25-acba-ec88bf0dd847 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:55.223839 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b9eaaf60-1e0e-4f25-acba-ec88bf0dd847 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:55.230829 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dd22442e-78ca-4eb9-b8f1-4aee9a19ab06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:55.238437 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-dd22442e-78ca-4eb9-b8f1-4aee9a19ab06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.230173 Sep 13 06:46:55.239015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 433/879] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:55 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:55.364869 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b9eaaf60-1e0e-4f25-acba-ec88bf0dd847 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:55.372579 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b9eaaf60-1e0e-4f25-acba-ec88bf0dd847 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.162366 Sep 13 06:46:55.373155 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 447/880] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:55 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:55.605793 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-876c8fe0-ecd7-4b0b-8445-81d1ad76fa08 req-9d671000-32c8-49f1-b808-b31fa4112f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd6a470-5bbf-4d29-b5e2-860f8f7c551b", "name": "network-vif-plugged", "status": "completed", "tag": "35c33167-d432-4f8a-b748-145b6562d972"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:46:55.617041 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-876c8fe0-ecd7-4b0b-8445-81d1ad76fa08 req-9d671000-32c8-49f1-b808-b31fa4112f26 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:55.617655 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-876c8fe0-ecd7-4b0b-8445-81d1ad76fa08 req-9d671000-32c8-49f1-b808-b31fa4112f26 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:55.618379 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-876c8fe0-ecd7-4b0b-8445-81d1ad76fa08 req-9d671000-32c8-49f1-b808-b31fa4112f26 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:55.630980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-876c8fe0-ecd7-4b0b-8445-81d1ad76fa08 req-9d671000-32c8-49f1-b808-b31fa4112f26 service nova] Creating event network-vif-plugged:35c33167-d432-4f8a-b748-145b6562d972 for instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b on hv-cinder-85638 Sep 13 06:46:55.636296 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-876c8fe0-ecd7-4b0b-8445-81d1ad76fa08 req-9d671000-32c8-49f1-b808-b31fa4112f26 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034241 Sep 13 06:46:55.637150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 434/881] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:46:56.260579 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ad5bb6f0-d4ed-4903-9b4e-e767c3cba929 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:56.261188 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ad5bb6f0-d4ed-4903-9b4e-e767c3cba929 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:56.267113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad5bb6f0-d4ed-4903-9b4e-e767c3cba929 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:56.267632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad5bb6f0-d4ed-4903-9b4e-e767c3cba929 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:56.268064 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad5bb6f0-d4ed-4903-9b4e-e767c3cba929 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:56.268749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad5bb6f0-d4ed-4903-9b4e-e767c3cba929 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:56.269201 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad5bb6f0-d4ed-4903-9b4e-e767c3cba929 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:56.269621 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad5bb6f0-d4ed-4903-9b4e-e767c3cba929 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:56.396376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5ecae397-ed41-4331-a87f-216a2becafc4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:56.397080 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5ecae397-ed41-4331-a87f-216a2becafc4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:56.399127 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:56.401649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ad5bb6f0-d4ed-4903-9b4e-e767c3cba929 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:56.404921 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ecae397-ed41-4331-a87f-216a2becafc4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:56.405327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ecae397-ed41-4331-a87f-216a2becafc4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:56.405764 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ecae397-ed41-4331-a87f-216a2becafc4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:56.406467 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ecae397-ed41-4331-a87f-216a2becafc4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:56.406958 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ecae397-ed41-4331-a87f-216a2becafc4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:56.407611 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5ecae397-ed41-4331-a87f-216a2becafc4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:56.410235 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ad5bb6f0-d4ed-4903-9b4e-e767c3cba929 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.153466 Sep 13 06:46:56.410804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 448/882] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:56 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:56.539559 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5ecae397-ed41-4331-a87f-216a2becafc4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:56.547155 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5ecae397-ed41-4331-a87f-216a2becafc4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.155500 Sep 13 06:46:56.547746 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 435/883] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:56 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:46:57.433373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e57108cc-936a-4c4d-9b0d-3db4709b3f23 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:57.433983 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e57108cc-936a-4c4d-9b0d-3db4709b3f23 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:57.440946 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e57108cc-936a-4c4d-9b0d-3db4709b3f23 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:57.441423 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e57108cc-936a-4c4d-9b0d-3db4709b3f23 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:57.441856 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e57108cc-936a-4c4d-9b0d-3db4709b3f23 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:57.442535 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e57108cc-936a-4c4d-9b0d-3db4709b3f23 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:57.442989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e57108cc-936a-4c4d-9b0d-3db4709b3f23 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:57.443436 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e57108cc-936a-4c4d-9b0d-3db4709b3f23 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:57.571143 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e0a1a129-3e28-4409-8d41-94bb111e8824 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:57.571740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e0a1a129-3e28-4409-8d41-94bb111e8824 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:57.578654 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0a1a129-3e28-4409-8d41-94bb111e8824 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:57.579153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0a1a129-3e28-4409-8d41-94bb111e8824 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:57.579701 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0a1a129-3e28-4409-8d41-94bb111e8824 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:57.580433 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0a1a129-3e28-4409-8d41-94bb111e8824 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:57.581100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0a1a129-3e28-4409-8d41-94bb111e8824 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:57.581529 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0a1a129-3e28-4409-8d41-94bb111e8824 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:57.716453 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e0a1a129-3e28-4409-8d41-94bb111e8824 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:57.722856 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e57108cc-936a-4c4d-9b0d-3db4709b3f23 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:57.724882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e0a1a129-3e28-4409-8d41-94bb111e8824 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1259 microversion: 2.1 time: 0.157900 Sep 13 06:46:57.725465 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 436/884] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:57 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:57.730645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e57108cc-936a-4c4d-9b0d-3db4709b3f23 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.301091 Sep 13 06:46:57.731199 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 449/885] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:57 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:58.747723 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6e239d3f-a2c1-44c8-b713-dbcbeb82272e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:58.748317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6e239d3f-a2c1-44c8-b713-dbcbeb82272e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:58.753535 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f09c2093-bf78-4336-acf4-72a1e138ab74 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:58.754256 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f09c2093-bf78-4336-acf4-72a1e138ab74 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:58.755338 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6e239d3f-a2c1-44c8-b713-dbcbeb82272e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:58.755851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6e239d3f-a2c1-44c8-b713-dbcbeb82272e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:58.756287 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6e239d3f-a2c1-44c8-b713-dbcbeb82272e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:58.756982 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6e239d3f-a2c1-44c8-b713-dbcbeb82272e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:58.757441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6e239d3f-a2c1-44c8-b713-dbcbeb82272e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:58.757867 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6e239d3f-a2c1-44c8-b713-dbcbeb82272e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:58.760500 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f09c2093-bf78-4336-acf4-72a1e138ab74 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:58.760980 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f09c2093-bf78-4336-acf4-72a1e138ab74 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:58.761416 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f09c2093-bf78-4336-acf4-72a1e138ab74 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:58.762104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f09c2093-bf78-4336-acf4-72a1e138ab74 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:58.762561 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f09c2093-bf78-4336-acf4-72a1e138ab74 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:58.762983 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f09c2093-bf78-4336-acf4-72a1e138ab74 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:58.889109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6e239d3f-a2c1-44c8-b713-dbcbeb82272e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:58.894526 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f09c2093-bf78-4336-acf4-72a1e138ab74 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:58.897217 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6e239d3f-a2c1-44c8-b713-dbcbeb82272e tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1443 microversion: 2.1 time: 0.153304 Sep 13 06:46:58.897998 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 437/886] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:58 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:58.902919 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f09c2093-bf78-4336-acf4-72a1e138ab74 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.153588 Sep 13 06:46:58.903577 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 450/887] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:58 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:58.920222 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ec39cdb7-2c81-45d0-9ba4-4228359a2fe4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:58.920820 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ec39cdb7-2c81-45d0-9ba4-4228359a2fe4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:58.927125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec39cdb7-2c81-45d0-9ba4-4228359a2fe4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:58.927633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec39cdb7-2c81-45d0-9ba4-4228359a2fe4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:58.928066 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec39cdb7-2c81-45d0-9ba4-4228359a2fe4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:58.928746 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec39cdb7-2c81-45d0-9ba4-4228359a2fe4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:58.929194 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec39cdb7-2c81-45d0-9ba4-4228359a2fe4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:58.929609 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ec39cdb7-2c81-45d0-9ba4-4228359a2fe4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:59.059978 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ec39cdb7-2c81-45d0-9ba4-4228359a2fe4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:46:59.068339 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ec39cdb7-2c81-45d0-9ba4-4228359a2fe4 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1443 microversion: 2.1 time: 0.151757 Sep 13 06:46:59.068912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 438/888] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:58 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:59.925315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2cc016f2-070f-4296-8ebe-92e4ee6594ff tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:46:59.926121 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2cc016f2-070f-4296-8ebe-92e4ee6594ff tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:46:59.932621 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2cc016f2-070f-4296-8ebe-92e4ee6594ff tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:59.933111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2cc016f2-070f-4296-8ebe-92e4ee6594ff tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:59.933536 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2cc016f2-070f-4296-8ebe-92e4ee6594ff tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:46:59.934227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2cc016f2-070f-4296-8ebe-92e4ee6594ff tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:46:59.934678 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2cc016f2-070f-4296-8ebe-92e4ee6594ff tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:46:59.935095 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2cc016f2-070f-4296-8ebe-92e4ee6594ff tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:00.070757 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2cc016f2-070f-4296-8ebe-92e4ee6594ff tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:00.078892 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2cc016f2-070f-4296-8ebe-92e4ee6594ff tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.157436 Sep 13 06:47:00.079497 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 451/889] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:46:59 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:47:00.712999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:00.713798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=6 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:00.717726 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-c6921347-b64c-41e7-9627-2f659bd352a3 req-454efa78-3ee4-4ad8-ad97-40b220cb46a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd6a470-5bbf-4d29-b5e2-860f8f7c551b", "tag": "35c33167-d432-4f8a-b748-145b6562d972"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:47:00.728549 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-c6921347-b64c-41e7-9627-2f659bd352a3 req-454efa78-3ee4-4ad8-ad97-40b220cb46a5 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:00.729036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-c6921347-b64c-41e7-9627-2f659bd352a3 req-454efa78-3ee4-4ad8-ad97-40b220cb46a5 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:00.729470 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-c6921347-b64c-41e7-9627-2f659bd352a3 req-454efa78-3ee4-4ad8-ad97-40b220cb46a5 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:00.742267 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-c6921347-b64c-41e7-9627-2f659bd352a3 req-454efa78-3ee4-4ad8-ad97-40b220cb46a5 service nova] Creating event network-changed:35c33167-d432-4f8a-b748-145b6562d972 for instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b on hv-cinder-85638 Sep 13 06:47:00.747223 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-c6921347-b64c-41e7-9627-2f659bd352a3 req-454efa78-3ee4-4ad8-ad97-40b220cb46a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035324 Sep 13 06:47:00.747925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 439/890] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:01.102583 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-06315c8c-a7de-4565-930f-0d545ce8a1df tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:01.103186 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-06315c8c-a7de-4565-930f-0d545ce8a1df tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:01.105144 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:01.111098 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06315c8c-a7de-4565-930f-0d545ce8a1df tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:01.111611 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06315c8c-a7de-4565-930f-0d545ce8a1df tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:01.112057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06315c8c-a7de-4565-930f-0d545ce8a1df tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:01.112729 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06315c8c-a7de-4565-930f-0d545ce8a1df tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:01.113178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06315c8c-a7de-4565-930f-0d545ce8a1df tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:01.113594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-06315c8c-a7de-4565-930f-0d545ce8a1df tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:01.250394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-06315c8c-a7de-4565-930f-0d545ce8a1df tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:01.258276 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-06315c8c-a7de-4565-930f-0d545ce8a1df tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.159578 Sep 13 06:47:01.258844 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 452/891] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:01 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:02.281664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-edb67de8-17da-47fa-9294-cb1e120862dc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:02.282383 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-edb67de8-17da-47fa-9294-cb1e120862dc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:02.289139 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edb67de8-17da-47fa-9294-cb1e120862dc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:02.289619 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edb67de8-17da-47fa-9294-cb1e120862dc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:02.290074 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edb67de8-17da-47fa-9294-cb1e120862dc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:02.290747 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edb67de8-17da-47fa-9294-cb1e120862dc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:02.291197 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edb67de8-17da-47fa-9294-cb1e120862dc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:02.291645 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edb67de8-17da-47fa-9294-cb1e120862dc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:02.424193 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-edb67de8-17da-47fa-9294-cb1e120862dc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:02.432238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-edb67de8-17da-47fa-9294-cb1e120862dc tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.155235 Sep 13 06:47:02.432805 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 440/892] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:02 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:03.454334 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7a97d556-7ca7-4a64-8ba9-5bc591857455 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:03.454937 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7a97d556-7ca7-4a64-8ba9-5bc591857455 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:03.462003 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a97d556-7ca7-4a64-8ba9-5bc591857455 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:03.462386 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a97d556-7ca7-4a64-8ba9-5bc591857455 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:03.462818 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a97d556-7ca7-4a64-8ba9-5bc591857455 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:03.463534 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a97d556-7ca7-4a64-8ba9-5bc591857455 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:03.463985 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a97d556-7ca7-4a64-8ba9-5bc591857455 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:03.464404 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7a97d556-7ca7-4a64-8ba9-5bc591857455 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:03.602213 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7a97d556-7ca7-4a64-8ba9-5bc591857455 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:03.609908 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7a97d556-7ca7-4a64-8ba9-5bc591857455 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.159513 Sep 13 06:47:03.610719 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 453/893] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:03 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:04.632067 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-eb74f576-d404-4b69-bcd7-7ff17cf16e89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:04.632668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-eb74f576-d404-4b69-bcd7-7ff17cf16e89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:04.639047 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-eb74f576-d404-4b69-bcd7-7ff17cf16e89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:04.639563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-eb74f576-d404-4b69-bcd7-7ff17cf16e89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:04.640000 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-eb74f576-d404-4b69-bcd7-7ff17cf16e89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:04.640681 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-eb74f576-d404-4b69-bcd7-7ff17cf16e89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:04.641137 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-eb74f576-d404-4b69-bcd7-7ff17cf16e89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:04.641557 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-eb74f576-d404-4b69-bcd7-7ff17cf16e89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:04.767886 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-eb74f576-d404-4b69-bcd7-7ff17cf16e89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:04.775400 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-eb74f576-d404-4b69-bcd7-7ff17cf16e89 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.147173 Sep 13 06:47:04.775962 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 441/894] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:04 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:05.629394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-437da32e-0723-4cf3-899b-5b82bdb87edd req-771086ea-30df-4287-9f52-d0bff3df2331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757cfd27-33d5-4139-adef-9d92d44795a7", "name": "network-vif-plugged", "status": "completed", "tag": "652aa8a2-ec94-42b2-8fc4-270bfe350fd4"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:47:05.640087 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-437da32e-0723-4cf3-899b-5b82bdb87edd req-771086ea-30df-4287-9f52-d0bff3df2331 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:05.640574 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-437da32e-0723-4cf3-899b-5b82bdb87edd req-771086ea-30df-4287-9f52-d0bff3df2331 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:05.641001 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-437da32e-0723-4cf3-899b-5b82bdb87edd req-771086ea-30df-4287-9f52-d0bff3df2331 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:05.652522 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-437da32e-0723-4cf3-899b-5b82bdb87edd req-771086ea-30df-4287-9f52-d0bff3df2331 service nova] Creating event network-vif-plugged:652aa8a2-ec94-42b2-8fc4-270bfe350fd4 for instance 757cfd27-33d5-4139-adef-9d92d44795a7 on hv-cinder-85638 Sep 13 06:47:05.657474 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-437da32e-0723-4cf3-899b-5b82bdb87edd req-771086ea-30df-4287-9f52-d0bff3df2331 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032462 Sep 13 06:47:05.658080 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 454/895] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:05.798324 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ab2b2796-091e-41c1-a6e5-56cc6243637a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:05.798930 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ab2b2796-091e-41c1-a6e5-56cc6243637a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:05.805860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab2b2796-091e-41c1-a6e5-56cc6243637a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:05.806351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab2b2796-091e-41c1-a6e5-56cc6243637a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:05.806796 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab2b2796-091e-41c1-a6e5-56cc6243637a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:05.807525 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab2b2796-091e-41c1-a6e5-56cc6243637a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:05.807984 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab2b2796-091e-41c1-a6e5-56cc6243637a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:05.808413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab2b2796-091e-41c1-a6e5-56cc6243637a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:05.974848 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ab2b2796-091e-41c1-a6e5-56cc6243637a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:05.982900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ab2b2796-091e-41c1-a6e5-56cc6243637a tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.188312 Sep 13 06:47:05.983381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 442/896] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:05 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:07.007261 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3de2eb73-3564-4fbb-8bb3-13d292f25490 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:07.007966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3de2eb73-3564-4fbb-8bb3-13d292f25490 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:07.013994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3de2eb73-3564-4fbb-8bb3-13d292f25490 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:07.014468 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3de2eb73-3564-4fbb-8bb3-13d292f25490 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:07.014895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3de2eb73-3564-4fbb-8bb3-13d292f25490 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:07.015611 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3de2eb73-3564-4fbb-8bb3-13d292f25490 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:07.016059 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3de2eb73-3564-4fbb-8bb3-13d292f25490 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:07.016480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3de2eb73-3564-4fbb-8bb3-13d292f25490 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:07.148321 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3de2eb73-3564-4fbb-8bb3-13d292f25490 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:07.155945 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3de2eb73-3564-4fbb-8bb3-13d292f25490 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1264 microversion: 2.1 time: 0.153834 Sep 13 06:47:07.156508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 455/897] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:07 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:08.178352 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c1093c13-ddff-4d6c-bfe0-d6e8c6f55a7f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:08.178959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c1093c13-ddff-4d6c-bfe0-d6e8c6f55a7f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:08.185187 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c1093c13-ddff-4d6c-bfe0-d6e8c6f55a7f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:08.185675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c1093c13-ddff-4d6c-bfe0-d6e8c6f55a7f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:08.186175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c1093c13-ddff-4d6c-bfe0-d6e8c6f55a7f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:08.186866 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c1093c13-ddff-4d6c-bfe0-d6e8c6f55a7f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:08.187321 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c1093c13-ddff-4d6c-bfe0-d6e8c6f55a7f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:08.187771 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c1093c13-ddff-4d6c-bfe0-d6e8c6f55a7f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:08.318555 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c1093c13-ddff-4d6c-bfe0-d6e8c6f55a7f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:08.326312 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c1093c13-ddff-4d6c-bfe0-d6e8c6f55a7f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1451 microversion: 2.1 time: 0.151974 Sep 13 06:47:08.327162 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 443/898] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:08 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:08.348873 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-439d438b-905d-41a8-8afa-3874af65348b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:08.349474 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-439d438b-905d-41a8-8afa-3874af65348b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:08.355809 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-439d438b-905d-41a8-8afa-3874af65348b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:08.356287 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-439d438b-905d-41a8-8afa-3874af65348b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:08.356713 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-439d438b-905d-41a8-8afa-3874af65348b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:08.357390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-439d438b-905d-41a8-8afa-3874af65348b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:08.357851 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-439d438b-905d-41a8-8afa-3874af65348b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:08.358259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-439d438b-905d-41a8-8afa-3874af65348b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:08.490173 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-439d438b-905d-41a8-8afa-3874af65348b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:08.497766 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-439d438b-905d-41a8-8afa-3874af65348b tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1451 microversion: 2.1 time: 0.152732 Sep 13 06:47:08.498317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 456/899] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:08 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:10.161471 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-0bf2cfc3-c8f5-4dc1-adb4-8600d0e47a1a req-200a472b-6885-4c73-821b-c42142a6a39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757cfd27-33d5-4139-adef-9d92d44795a7", "tag": "652aa8a2-ec94-42b2-8fc4-270bfe350fd4"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:47:10.170983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-0bf2cfc3-c8f5-4dc1-adb4-8600d0e47a1a req-200a472b-6885-4c73-821b-c42142a6a39b service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:10.171485 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-0bf2cfc3-c8f5-4dc1-adb4-8600d0e47a1a req-200a472b-6885-4c73-821b-c42142a6a39b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:10.171916 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-0bf2cfc3-c8f5-4dc1-adb4-8600d0e47a1a req-200a472b-6885-4c73-821b-c42142a6a39b service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:10.182882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-0bf2cfc3-c8f5-4dc1-adb4-8600d0e47a1a req-200a472b-6885-4c73-821b-c42142a6a39b service nova] Creating event network-changed:652aa8a2-ec94-42b2-8fc4-270bfe350fd4 for instance 757cfd27-33d5-4139-adef-9d92d44795a7 on hv-cinder-85638 Sep 13 06:47:10.187810 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-0bf2cfc3-c8f5-4dc1-adb4-8600d0e47a1a req-200a472b-6885-4c73-821b-c42142a6a39b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031317 Sep 13 06:47:10.188393 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 444/900] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:10.869369 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1b5abe2c-1975-41af-9691-654d85fee60f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:10.869895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1b5abe2c-1975-41af-9691-654d85fee60f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:10.872211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=54 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:10.877606 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5abe2c-1975-41af-9691-654d85fee60f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:10.878187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5abe2c-1975-41af-9691-654d85fee60f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:10.879055 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5abe2c-1975-41af-9691-654d85fee60f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:10.879782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5abe2c-1975-41af-9691-654d85fee60f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:10.880235 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5abe2c-1975-41af-9691-654d85fee60f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:10.880654 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5abe2c-1975-41af-9691-654d85fee60f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:10.903850 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1b5abe2c-1975-41af-9691-654d85fee60f tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/ips" status: 200 len: 146 microversion: 2.1 time: 0.038460 Sep 13 06:47:10.904420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 457/901] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Sep 13 06:47:10 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:13.305634 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-63225993-6104-4cbb-8ecc-a9cf4a63add7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a16a0030-4a62-435e-9f1d-6c13b3b6a231"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:47:13.308048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-63225993-6104-4cbb-8ecc-a9cf4a63add7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:13.314083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63225993-6104-4cbb-8ecc-a9cf4a63add7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:13.314569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63225993-6104-4cbb-8ecc-a9cf4a63add7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:13.315013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63225993-6104-4cbb-8ecc-a9cf4a63add7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:13.316369 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63225993-6104-4cbb-8ecc-a9cf4a63add7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:13.316826 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63225993-6104-4cbb-8ecc-a9cf4a63add7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:13.317250 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-63225993-6104-4cbb-8ecc-a9cf4a63add7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:13.502020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:13.613650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-63225993-6104-4cbb-8ecc-a9cf4a63add7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313076 Sep 13 06:47:13.617425 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 445/902] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:47:13 2022] POST /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:21.138058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-af912477-6be2-41b1-a9e2-07c31ee74800 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:21.140214 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-af912477-6be2-41b1-a9e2-07c31ee74800 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:21.142882 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:21.143559 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=67 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:21.150362 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-af912477-6be2-41b1-a9e2-07c31ee74800 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:21.150842 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-af912477-6be2-41b1-a9e2-07c31ee74800 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:21.151272 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-af912477-6be2-41b1-a9e2-07c31ee74800 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:21.151989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-af912477-6be2-41b1-a9e2-07c31ee74800 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:21.152440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-af912477-6be2-41b1-a9e2-07c31ee74800 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:21.152858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-af912477-6be2-41b1-a9e2-07c31ee74800 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:21.181445 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-af912477-6be2-41b1-a9e2-07c31ee74800 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047262 Sep 13 06:47:21.181980 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 458/903] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:47:21 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:21.194208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ed2e208a-6158-48af-b23a-0d0dd4925b9a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:21.194786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ed2e208a-6158-48af-b23a-0d0dd4925b9a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:21.200814 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ed2e208a-6158-48af-b23a-0d0dd4925b9a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:21.201291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ed2e208a-6158-48af-b23a-0d0dd4925b9a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:21.201728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ed2e208a-6158-48af-b23a-0d0dd4925b9a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:21.202410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ed2e208a-6158-48af-b23a-0d0dd4925b9a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:21.202861 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ed2e208a-6158-48af-b23a-0d0dd4925b9a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:21.203279 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ed2e208a-6158-48af-b23a-0d0dd4925b9a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:21.231862 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ed2e208a-6158-48af-b23a-0d0dd4925b9a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments/a16a0030-4a62-435e-9f1d-6c13b3b6a231" status: 200 len: 194 microversion: 2.1 time: 0.043001 Sep 13 06:47:21.232432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 446/904] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Sep 13 06:47:21 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments/a16a0030-4a62-435e-9f1d-6c13b3b6a231 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:22.561313 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-23c07040-f5ff-4a43-b03c-eca73e6040d7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c070da6-c295-4095-b7a1-53075624740a"}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:47:22.563630 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-23c07040-f5ff-4a43-b03c-eca73e6040d7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:22.570733 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-23c07040-f5ff-4a43-b03c-eca73e6040d7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:22.571218 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-23c07040-f5ff-4a43-b03c-eca73e6040d7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:22.572760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-23c07040-f5ff-4a43-b03c-eca73e6040d7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:22.572760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-23c07040-f5ff-4a43-b03c-eca73e6040d7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:22.572982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-23c07040-f5ff-4a43-b03c-eca73e6040d7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:22.573256 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-23c07040-f5ff-4a43-b03c-eca73e6040d7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:22.862211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-23c07040-f5ff-4a43-b03c-eca73e6040d7 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "POST /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304641 Sep 13 06:47:22.862977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 459/905] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:47:22 2022] POST /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:31.445335 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a67ffcde-dc36-4f5f-852f-92bb638022e6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:31.447643 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a67ffcde-dc36-4f5f-852f-92bb638022e6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:31.450187 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=23 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:31.450845 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=10,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:31.457097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a67ffcde-dc36-4f5f-852f-92bb638022e6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:31.457584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a67ffcde-dc36-4f5f-852f-92bb638022e6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:31.458021 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a67ffcde-dc36-4f5f-852f-92bb638022e6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:31.458714 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a67ffcde-dc36-4f5f-852f-92bb638022e6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:31.459171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a67ffcde-dc36-4f5f-852f-92bb638022e6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:31.459621 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a67ffcde-dc36-4f5f-852f-92bb638022e6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:31.492472 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a67ffcde-dc36-4f5f-852f-92bb638022e6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051070 Sep 13 06:47:31.493032 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 447/906] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:47:31 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:31.638780 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4e0e0bb5-4a38-4a7b-a1d9-519c5fd2bd8e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:31.639379 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4e0e0bb5-4a38-4a7b-a1d9-519c5fd2bd8e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:31.645544 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e0e0bb5-4a38-4a7b-a1d9-519c5fd2bd8e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:31.646030 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e0e0bb5-4a38-4a7b-a1d9-519c5fd2bd8e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:31.646467 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e0e0bb5-4a38-4a7b-a1d9-519c5fd2bd8e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:31.647163 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e0e0bb5-4a38-4a7b-a1d9-519c5fd2bd8e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:31.647637 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e0e0bb5-4a38-4a7b-a1d9-519c5fd2bd8e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:31.648064 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4e0e0bb5-4a38-4a7b-a1d9-519c5fd2bd8e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:31.680054 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4e0e0bb5-4a38-4a7b-a1d9-519c5fd2bd8e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments/a16a0030-4a62-435e-9f1d-6c13b3b6a231" status: 200 len: 194 microversion: 2.1 time: 0.046190 Sep 13 06:47:31.680649 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 460/907] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Sep 13 06:47:31 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments/a16a0030-4a62-435e-9f1d-6c13b3b6a231 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:31.691113 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b3fcaeb4-fcb2-4420-9499-0fac3d9dea8a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:31.691684 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b3fcaeb4-fcb2-4420-9499-0fac3d9dea8a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:31.697557 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b3fcaeb4-fcb2-4420-9499-0fac3d9dea8a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:31.698040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b3fcaeb4-fcb2-4420-9499-0fac3d9dea8a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:31.698479 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b3fcaeb4-fcb2-4420-9499-0fac3d9dea8a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:31.699165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b3fcaeb4-fcb2-4420-9499-0fac3d9dea8a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:31.699649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b3fcaeb4-fcb2-4420-9499-0fac3d9dea8a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:31.700079 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b3fcaeb4-fcb2-4420-9499-0fac3d9dea8a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:31.780392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-b3fcaeb4-fcb2-4420-9499-0fac3d9dea8a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lazy-loading 'services' on Instance uuid 1b94d975-3eb2-4a82-bafe-c0b5a442f122 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:47:31.850814 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b3fcaeb4-fcb2-4420-9499-0fac3d9dea8a tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments/a16a0030-4a62-435e-9f1d-6c13b3b6a231" status: 202 len: 0 microversion: 2.1 time: 0.163478 Sep 13 06:47:31.851499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 448/908] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:47:31 2022] DELETE /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments/a16a0030-4a62-435e-9f1d-6c13b3b6a231 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:47:34.036759 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-24b45639-503e-49ea-9734-a8f36dce5113 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:34.037270 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-24b45639-503e-49ea-9734-a8f36dce5113 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:34.043859 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b45639-503e-49ea-9734-a8f36dce5113 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:34.044340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b45639-503e-49ea-9734-a8f36dce5113 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:34.044768 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b45639-503e-49ea-9734-a8f36dce5113 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:34.045450 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b45639-503e-49ea-9734-a8f36dce5113 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:34.045900 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b45639-503e-49ea-9734-a8f36dce5113 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:34.046315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b45639-503e-49ea-9734-a8f36dce5113 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:34.073898 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-24b45639-503e-49ea-9734-a8f36dce5113 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments/6c070da6-c295-4095-b7a1-53075624740a" status: 200 len: 194 microversion: 2.1 time: 0.041903 Sep 13 06:47:34.074464 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 461/909] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Sep 13 06:47:34 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments/6c070da6-c295-4095-b7a1-53075624740a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:34.086728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-19ffe13a-a87c-46ef-9802-d8b5233f6d37 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:34.087319 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-19ffe13a-a87c-46ef-9802-d8b5233f6d37 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:34.093325 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-19ffe13a-a87c-46ef-9802-d8b5233f6d37 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:34.093801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-19ffe13a-a87c-46ef-9802-d8b5233f6d37 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:34.094233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-19ffe13a-a87c-46ef-9802-d8b5233f6d37 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:34.094918 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-19ffe13a-a87c-46ef-9802-d8b5233f6d37 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:34.095448 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-19ffe13a-a87c-46ef-9802-d8b5233f6d37 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:34.095823 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-19ffe13a-a87c-46ef-9802-d8b5233f6d37 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:34.175616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-19ffe13a-a87c-46ef-9802-d8b5233f6d37 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lazy-loading 'services' on Instance uuid 1b94d975-3eb2-4a82-bafe-c0b5a442f122 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:47:34.248699 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-19ffe13a-a87c-46ef-9802-d8b5233f6d37 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments/6c070da6-c295-4095-b7a1-53075624740a" status: 202 len: 0 microversion: 2.1 time: 0.167159 Sep 13 06:47:34.249347 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 449/910] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:47:34 2022] DELETE /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments/6c070da6-c295-4095-b7a1-53075624740a => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:47:36.498979 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d498f742-3c1a-41a5-a3a7-2883d1371c76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:36.501230 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d498f742-3c1a-41a5-a3a7-2883d1371c76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:36.507535 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d498f742-3c1a-41a5-a3a7-2883d1371c76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:36.508023 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d498f742-3c1a-41a5-a3a7-2883d1371c76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:36.508464 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d498f742-3c1a-41a5-a3a7-2883d1371c76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:36.509154 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d498f742-3c1a-41a5-a3a7-2883d1371c76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:36.509610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d498f742-3c1a-41a5-a3a7-2883d1371c76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:36.510035 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d498f742-3c1a-41a5-a3a7-2883d1371c76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:36.539859 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d498f742-3c1a-41a5-a3a7-2883d1371c76 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044608 Sep 13 06:47:36.540410 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 462/911] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:47:36 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 06:47:36.654337 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0258592a-b081-4a3a-ac4e-3fd6ad99e2c5 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:36.656588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0258592a-b081-4a3a-ac4e-3fd6ad99e2c5 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:36.662872 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0258592a-b081-4a3a-ac4e-3fd6ad99e2c5 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:36.663346 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0258592a-b081-4a3a-ac4e-3fd6ad99e2c5 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:36.663806 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0258592a-b081-4a3a-ac4e-3fd6ad99e2c5 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:36.664481 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0258592a-b081-4a3a-ac4e-3fd6ad99e2c5 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:36.664929 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0258592a-b081-4a3a-ac4e-3fd6ad99e2c5 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:36.665343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0258592a-b081-4a3a-ac4e-3fd6ad99e2c5 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:36.693563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0258592a-b081-4a3a-ac4e-3fd6ad99e2c5 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044004 Sep 13 06:47:36.694105 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 450/912] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:47:36 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 06:47:36.755260 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-50821ad1-a259-43d2-9af6-6538a9706c19 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:36.755804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-50821ad1-a259-43d2-9af6-6538a9706c19 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:36.761655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50821ad1-a259-43d2-9af6-6538a9706c19 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:36.762140 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50821ad1-a259-43d2-9af6-6538a9706c19 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:36.762580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50821ad1-a259-43d2-9af6-6538a9706c19 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:36.763276 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50821ad1-a259-43d2-9af6-6538a9706c19 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:36.763766 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50821ad1-a259-43d2-9af6-6538a9706c19 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:36.764197 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50821ad1-a259-43d2-9af6-6538a9706c19 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:36.789027 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-50821ad1-a259-43d2-9af6-6538a9706c19 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:47:36.860781 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-50821ad1-a259-43d2-9af6-6538a9706c19 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 204 len: 0 microversion: 2.1 time: 0.109647 Sep 13 06:47:36.861564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 463/913] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:47:36 2022] DELETE /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:36.870598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b511d92f-e7e1-414a-92e5-ee0689880ec6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:36.871213 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b511d92f-e7e1-414a-92e5-ee0689880ec6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:36.877066 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b511d92f-e7e1-414a-92e5-ee0689880ec6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:36.877550 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b511d92f-e7e1-414a-92e5-ee0689880ec6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:36.877985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b511d92f-e7e1-414a-92e5-ee0689880ec6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:36.878677 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b511d92f-e7e1-414a-92e5-ee0689880ec6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:36.879135 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b511d92f-e7e1-414a-92e5-ee0689880ec6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:36.880239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b511d92f-e7e1-414a-92e5-ee0689880ec6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:37.012527 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b511d92f-e7e1-414a-92e5-ee0689880ec6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:37.020184 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b511d92f-e7e1-414a-92e5-ee0689880ec6 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1674 microversion: 2.1 time: 0.154033 Sep 13 06:47:37.020740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 451/914] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:36 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:38.044172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2461bbf7-3ccd-4453-ba93-b8ecceb52794 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:38.044865 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2461bbf7-3ccd-4453-ba93-b8ecceb52794 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:38.051198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2461bbf7-3ccd-4453-ba93-b8ecceb52794 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:38.051709 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2461bbf7-3ccd-4453-ba93-b8ecceb52794 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:38.052141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2461bbf7-3ccd-4453-ba93-b8ecceb52794 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:38.052817 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2461bbf7-3ccd-4453-ba93-b8ecceb52794 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:38.053264 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2461bbf7-3ccd-4453-ba93-b8ecceb52794 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:38.053709 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2461bbf7-3ccd-4453-ba93-b8ecceb52794 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:38.181819 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2461bbf7-3ccd-4453-ba93-b8ecceb52794 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:38.189571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2461bbf7-3ccd-4453-ba93-b8ecceb52794 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1674 microversion: 2.1 time: 0.149558 Sep 13 06:47:38.190129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 464/915] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:38 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:39.213644 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6a5dc739-40be-4888-b90b-1969843dd5b0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:39.214255 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6a5dc739-40be-4888-b90b-1969843dd5b0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:39.220561 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a5dc739-40be-4888-b90b-1969843dd5b0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:39.221041 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a5dc739-40be-4888-b90b-1969843dd5b0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:39.221497 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a5dc739-40be-4888-b90b-1969843dd5b0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:39.222172 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a5dc739-40be-4888-b90b-1969843dd5b0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:39.222622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a5dc739-40be-4888-b90b-1969843dd5b0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:39.223566 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a5dc739-40be-4888-b90b-1969843dd5b0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:39.429975 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6a5dc739-40be-4888-b90b-1969843dd5b0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:39.438149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6a5dc739-40be-4888-b90b-1969843dd5b0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1674 microversion: 2.1 time: 0.228347 Sep 13 06:47:39.438717 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 452/916] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:39 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1674 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:47:40.462240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1cc5de31-0d10-41ee-8591-1500a618e516 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:40.462846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1cc5de31-0d10-41ee-8591-1500a618e516 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:40.469207 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cc5de31-0d10-41ee-8591-1500a618e516 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:40.469688 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cc5de31-0d10-41ee-8591-1500a618e516 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:40.470120 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cc5de31-0d10-41ee-8591-1500a618e516 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:40.470814 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cc5de31-0d10-41ee-8591-1500a618e516 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:40.471267 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cc5de31-0d10-41ee-8591-1500a618e516 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:40.471749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cc5de31-0d10-41ee-8591-1500a618e516 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:40.537136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1cc5de31-0d10-41ee-8591-1500a618e516 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b45d538d6e4749b3997d5e6845dfe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2645e663e8564c0bb7e0da327a6019bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:47:40.554660 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1cc5de31-0d10-41ee-8591-1500a618e516 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 200 len: 1607 microversion: 2.1 time: 0.096854 Sep 13 06:47:40.555465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 465/917] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:40 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 1607 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:40.584416 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-3e46cf5e-061d-4dde-a6f8-cd36abc3f060 req-9cd3512e-9c6f-4b7a-8c38-2d89a8c917e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b94d975-3eb2-4a82-bafe-c0b5a442f122", "name": "network-vif-deleted", "tag": "c9330f0b-a90e-45e8-ab95-6401cdf4237e"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:47:40.602808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-3e46cf5e-061d-4dde-a6f8-cd36abc3f060 req-9cd3512e-9c6f-4b7a-8c38-2d89a8c917e9 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:40.603286 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-3e46cf5e-061d-4dde-a6f8-cd36abc3f060 req-9cd3512e-9c6f-4b7a-8c38-2d89a8c917e9 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:40.603752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-3e46cf5e-061d-4dde-a6f8-cd36abc3f060 req-9cd3512e-9c6f-4b7a-8c38-2d89a8c917e9 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:40.617240 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-3e46cf5e-061d-4dde-a6f8-cd36abc3f060 req-9cd3512e-9c6f-4b7a-8c38-2d89a8c917e9 service nova] Creating event network-vif-deleted:c9330f0b-a90e-45e8-ab95-6401cdf4237e for instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 on hv-cinder-85638 Sep 13 06:47:40.626948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-3e46cf5e-061d-4dde-a6f8-cd36abc3f060 req-9cd3512e-9c6f-4b7a-8c38-2d89a8c917e9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046964 Sep 13 06:47:40.628855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 453/918] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:47:41.577634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:41.578249 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:41.585022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:41.585521 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:41.585954 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:41.586656 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:41.587113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:41.587570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:41.601413 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] HTTP exception thrown: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Request method failure captured: Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 HTTP/1.1 Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUq7ZR7NnSJM6Q51gWE3W5BdgHfXarWcdRmC9CkOEZupdLGEyEY8Tm3qtbsmzMKlAMf1YEJdnnKZ_DTtw0lqGgDXyFDRce9uI00yNcBT4bzkOsdT_DtwHWRl2pJWANYEuRyWYQfGlWSWO-QEFxQkCwr1_krr3_HnIr0OXMYfq5Cqzs Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:47:41.603067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: a8b45d538d6e4749b3997d5e6845dfe5 Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:41.604705 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '1b94d975-3eb2-4a82-bafe-c0b5a442f122'} Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:47:41.605670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:41.607349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:41.608804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Returning 404 to user: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:47:41.608804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9eff55ba-e057-44fc-8393-ca87ce510ef2 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 404 len: 111 microversion: 2.1 time: 0.030793 Sep 13 06:47:41.608804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 466/919] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:41 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 06:47:41.614475 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a9159ac5-f3ea-49e9-84d2-c0cbec39708e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '.version_select at 0x7fdc0d399280>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:41.633251 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a9159ac5-f3ea-49e9-84d2-c0cbec39708e tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110026259" status: 202 len: 0 microversion: 2.1 time: 0.023364 Sep 13 06:47:41.633820 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 454/920] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Sep 13 06:47:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110026259 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:47:44.506814 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:44.507348 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:44.513848 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:44.514328 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:44.514762 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:44.515474 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:44.515933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:44.516365 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:44.529511 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] HTTP exception thrown: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Request method failure captured: Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: DELETE /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 HTTP/1.1 Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUq7ZR7NnSJM6Q51gWE3W5BdgHfXarWcdRmC9CkOEZupdLGEyEY8Tm3qtbsmzMKlAMf1YEJdnnKZ_DTtw0lqGgDXyFDRce9uI00yNcBT4bzkOsdT_DtwHWRl2pJWANYEuRyWYQfGlWSWO-QEFxQkCwr1_krr3_HnIr0OXMYfq5Cqzs Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:47:44.531037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: a8b45d538d6e4749b3997d5e6845dfe5 Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:44.532635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '1b94d975-3eb2-4a82-bafe-c0b5a442f122'} Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:47:44.533550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:44.535024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:44.536532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Returning 404 to user: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:47:44.536532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-22301e93-6db6-4592-af38-7b12809db6ce tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 404 len: 111 microversion: 2.1 time: 0.030070 Sep 13 06:47:44.536532 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 467/921] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:47:44 2022] DELETE /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:47:44.543096 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:44.543858 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 1b94d975-3eb2-4a82-bafe-c0b5a442f122] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:44.550626 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:44.551664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:44.552109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:44.552803 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:44.553266 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:44.553694 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:44.566506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] HTTP exception thrown: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Request method failure captured: Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 HTTP/1.1 Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUq7ZR7NnSJM6Q51gWE3W5BdgHfXarWcdRmC9CkOEZupdLGEyEY8Tm3qtbsmzMKlAMf1YEJdnnKZ_DTtw0lqGgDXyFDRce9uI00yNcBT4bzkOsdT_DtwHWRl2pJWANYEuRyWYQfGlWSWO-QEFxQkCwr1_krr3_HnIr0OXMYfq5Cqzs Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:47:44.568752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: a8b45d538d6e4749b3997d5e6845dfe5 Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:44.570349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '1b94d975-3eb2-4a82-bafe-c0b5a442f122'} Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:47:44.571149 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. Sep 13 06:47:44.572509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:47:44.573610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Returning 404 to user: Instance 1b94d975-3eb2-4a82-bafe-c0b5a442f122 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:47:44.573610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-bc94182f-b8ca-4ecd-ad3a-37a2279365c0 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122" status: 404 len: 111 microversion: 2.1 time: 0.032104 Sep 13 06:47:44.573610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 455/922] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:44 2022] GET /compute/v2.1/servers/1b94d975-3eb2-4a82-bafe-c0b5a442f122 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:47:45.706465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:45.706954 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:45.714045 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:45.714521 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:45.714948 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:45.715659 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:45.716109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:45.716527 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:45.729555 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] HTTP exception thrown: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Request method failure captured: Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: DELETE /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 HTTP/1.1 Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUq7ZR7NnSJM6Q51gWE3W5BdgHfXarWcdRmC9CkOEZupdLGEyEY8Tm3qtbsmzMKlAMf1YEJdnnKZ_DTtw0lqGgDXyFDRce9uI00yNcBT4bzkOsdT_DtwHWRl2pJWANYEuRyWYQfGlWSWO-QEFxQkCwr1_krr3_HnIr0OXMYfq5Cqzs Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:47:45.731061 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: a8b45d538d6e4749b3997d5e6845dfe5 Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:47:45.732646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '4e145800-524d-4430-b95f-aff5b2719b66'} Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:47:45.733483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:47:45.734731 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:47:45.736134 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Returning 404 to user: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:47:45.736134 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8571e9de-18d5-4608-a253-d8b67936c386 tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 404 len: 111 microversion: 2.1 time: 0.029984 Sep 13 06:47:45.736134 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 468/923] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:47:45 2022] DELETE /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:47:45.740767 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:45.741450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] [instance: 4e145800-524d-4430-b95f-aff5b2719b66] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:45.747802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:45.748285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:45.748720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:45.749410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:45.749865 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:45.750313 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:45.763943 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] HTTP exception thrown: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Request method failure captured: Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 HTTP/1.1 Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUq7ZR7NnSJM6Q51gWE3W5BdgHfXarWcdRmC9CkOEZupdLGEyEY8Tm3qtbsmzMKlAMf1YEJdnnKZ_DTtw0lqGgDXyFDRce9uI00yNcBT4bzkOsdT_DtwHWRl2pJWANYEuRyWYQfGlWSWO-QEFxQkCwr1_krr3_HnIr0OXMYfq5Cqzs Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:47:45.765422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2645e663e8564c0bb7e0da327a6019bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 2645e663e8564c0bb7e0da327a6019bf Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1423569547 Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: a8b45d538d6e4749b3997d5e6845dfe5 Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeTestJSON-1423569547-project Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:47:45.766989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '4e145800-524d-4430-b95f-aff5b2719b66'} Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:47:45.767816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. Sep 13 06:47:45.769059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:47:45.770706 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] Returning 404 to user: Instance 4e145800-524d-4430-b95f-aff5b2719b66 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:47:45.770706 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-35d7a490-3f82-4b17-baf8-fbaf4f0f50eb tempest-AttachVolumeTestJSON-1423569547 tempest-AttachVolumeTestJSON-1423569547-project] 10.222.0.17 "GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66" status: 404 len: 111 microversion: 2.1 time: 0.029842 Sep 13 06:47:45.770706 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 456/924] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:47:45 2022] GET /compute/v2.1/servers/4e145800-524d-4430-b95f-aff5b2719b66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:47:56.792274 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ae297475-f97e-4acf-92c2-dc2234284669 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:47:56.792853 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ae297475-f97e-4acf-92c2-dc2234284669 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:56.795469 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:56.796108 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:56.801327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae297475-f97e-4acf-92c2-dc2234284669 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:56.801805 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae297475-f97e-4acf-92c2-dc2234284669 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:56.802263 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae297475-f97e-4acf-92c2-dc2234284669 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:56.802944 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae297475-f97e-4acf-92c2-dc2234284669 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:56.803415 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae297475-f97e-4acf-92c2-dc2234284669 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:56.803839 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae297475-f97e-4acf-92c2-dc2234284669 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:56.830307 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ae297475-f97e-4acf-92c2-dc2234284669 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/ips" status: 200 len: 152 microversion: 2.20 time: 0.042934 Sep 13 06:47:56.830799 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 469/925] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Sep 13 06:47:56 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:47:59.730676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d246a79d-855c-479d-86c6-3ed3866f0eed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:47:59.731204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d246a79d-855c-479d-86c6-3ed3866f0eed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:47:59.733799 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:59.734431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:59.740312 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d246a79d-855c-479d-86c6-3ed3866f0eed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:59.740833 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d246a79d-855c-479d-86c6-3ed3866f0eed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:59.741287 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d246a79d-855c-479d-86c6-3ed3866f0eed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:59.741965 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d246a79d-855c-479d-86c6-3ed3866f0eed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:47:59.742414 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d246a79d-855c-479d-86c6-3ed3866f0eed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:47:59.742835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d246a79d-855c-479d-86c6-3ed3866f0eed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:47:59.765612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-d246a79d-855c-479d-86c6-3ed3866f0eed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lazy-loading 'flavor' on Instance uuid fd984c2d-db41-44f6-9324-394602908a4b {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:48:00.110468 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d246a79d-855c-479d-86c6-3ed3866f0eed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "POST /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/action" status: 202 len: 0 microversion: 2.20 time: 0.383471 Sep 13 06:48:00.111125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 457/926] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Sep 13 06:47:59 2022] POST /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:48:00.120240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:00.127645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:00.128123 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:00.128805 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:00.129406 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:00.130153 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:00.131160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:00.131160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:00.358060 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:00.366207 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:00.367673 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:00.368829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fc333064-0005-4d5e-913d-f0a77fc75358 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.253404 Sep 13 06:48:00.369526 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 470/927] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:00 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:01.395202 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:01.395852 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:01.402018 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:01.402500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:01.402938 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:01.403664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:01.404125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:01.404554 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:01.533024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:01.542006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:01.543483 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:01.544651 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6539508c-f9c3-420c-90b2-75d8ba6e52b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.154334 Sep 13 06:48:01.545201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 458/928] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:01 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:02.570754 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:02.571328 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:02.577601 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:02.578073 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:02.578499 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:02.579208 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:02.579687 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:02.580118 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:02.706472 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:02.714521 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:02.716069 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:02.717221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e6cc9890-5ba8-4699-bc4e-c291da00202c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.150956 Sep 13 06:48:02.717779 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 471/929] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:02 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:03.742257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:03.742957 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:03.749271 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:03.749757 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:03.750192 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:03.750886 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:03.751344 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:03.751793 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:03.880830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:03.889349 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:03.890766 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:03.891961 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-58cb1257-6cf9-49e1-87eb-d0ad4d55cf9d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.153811 Sep 13 06:48:03.892528 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 459/930] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:03 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:04.920343 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:04.920974 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:04.928773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:04.929269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:04.929777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:04.930468 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:04.930917 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:04.931339 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:05.063405 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:05.072039 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:05.073462 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:05.074602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1b5b0c69-145d-4be0-b79e-3f4b583ea973 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.158385 Sep 13 06:48:05.075156 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 472/931] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:04 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:06.099333 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:06.100425 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:06.106634 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:06.107115 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:06.107589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:06.108280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:06.108732 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:06.109162 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:06.241361 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:06.249623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:06.251070 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:06.252519 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-53c9a930-c809-4ddd-bda8-712a735c88c3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.156861 Sep 13 06:48:06.253490 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 460/932] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:06 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:07.277978 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:07.278578 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:07.284862 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:07.285339 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:07.285769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:07.286452 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:07.286896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:07.287313 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:07.429327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:07.437684 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:07.439239 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:07.440433 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-50289105-b0c8-43f2-acf8-1fa9f688f152 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.166347 Sep 13 06:48:07.441317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 473/933] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:07 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:08.466406 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:08.467003 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:08.472843 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:08.473325 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:08.473759 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:08.474441 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:08.475556 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:08.475983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:08.605503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:08.614665 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:08.616259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:08.617635 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-269ee2e9-d0b1-4ad0-bf08-b3cd489a0867 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.155259 Sep 13 06:48:08.618693 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 461/934] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:08 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:09.642981 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:09.643636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:09.650062 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:09.650549 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:09.650988 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:09.651708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:09.652169 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:09.652595 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:09.785895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:09.795172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:09.796741 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:09.797872 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0a922b70-107c-44f4-9267-8a87b1eb63cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.158870 Sep 13 06:48:09.798586 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 474/935] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:09 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:10.824633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:10.825232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:10.831799 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:10.832289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:10.832739 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:10.833458 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:10.833966 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:10.834390 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:10.972692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:10.980680 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:10.982110 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:10.983266 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-31e96e5d-6dea-4f45-9688-d956596b26b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.162444 Sep 13 06:48:10.983844 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 462/936] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:10 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:12.007966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:12.008682 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:12.016352 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:12.016838 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:12.017271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:12.017977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:12.018488 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:12.018930 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:12.158542 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:12.167596 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:12.169043 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:12.170189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e61e524f-6ae3-4584-a2bf-9ee39a186359 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.166191 Sep 13 06:48:12.170751 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 475/937] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:12 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:13.196163 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:13.196768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:13.203498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:13.203995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:13.204433 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:13.205129 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:13.205587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:13.206014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:13.342739 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:13.351962 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:13.354280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:13.355472 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1e2c38dd-ed7f-45bb-93eb-11de4b7acd56 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.163806 Sep 13 06:48:13.356061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 463/938] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:13 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:14.383225 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:14.383801 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:14.390135 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:14.390606 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:14.391040 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:14.391761 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:14.392211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:14.392626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:14.522627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:14.530623 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:14.532093 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:14.533241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e3276126-4caf-481a-91a8-0d29a348d31e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.154462 Sep 13 06:48:14.533790 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 476/939] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:14 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:15.558021 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:15.558636 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:15.565081 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:15.565562 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:15.566004 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:15.566692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:15.567148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:15.567599 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:15.697825 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:15.705927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:15.707382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:15.708603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-61b8c180-668e-4092-be0b-4e16f7af73d7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.154546 Sep 13 06:48:15.709159 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 464/940] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:15 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:16.734050 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:16.734690 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:16.741112 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:16.741586 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:16.742054 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:16.742746 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:16.743198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:16.743645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:16.870776 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:16.878847 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:16.880329 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:16.881477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8d856468-e3b1-4ee3-b5f3-472977319a05 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.151396 Sep 13 06:48:16.882032 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 477/941] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:16 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:17.907102 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:17.907651 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:17.914709 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:17.915186 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:17.915643 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:17.916322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:17.916777 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:17.917195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:18.046197 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:18.055198 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:18.056691 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:18.057873 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-292f2c9d-5c42-418c-874a-aa388763424b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.154745 Sep 13 06:48:18.058435 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 465/942] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:17 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:48:19.083116 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:19.083704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:19.090587 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:19.091069 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:19.091548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:19.092236 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:19.092689 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:19.093112 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:19.222625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:19.231178 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:19.232654 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:19.233818 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ae2d2c94-bbe1-4e35-955a-402511442003 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.154664 Sep 13 06:48:19.234363 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 478/943] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:19 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:20.258104 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:20.258689 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:20.265079 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:20.265559 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:20.265993 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:20.266690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:20.267146 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:20.267600 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:20.396951 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:20.405092 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:20.406522 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:20.407707 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-835827b9-d912-42e7-a098-ef34bd69305b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.153578 Sep 13 06:48:20.408266 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 466/944] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:20 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:21.434172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:21.434778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:21.441128 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:21.441610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:21.442080 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:21.442766 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:21.443220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:21.444307 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:21.573580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:21.581597 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:21.583047 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:21.584285 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-95c4ea67-f363-4c38-a174-4b66334b8638 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.153955 Sep 13 06:48:21.584787 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 479/945] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:21 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:22.609626 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:22.610235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:22.616748 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:22.617232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:22.617667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:22.618354 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:22.618809 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:22.619231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:22.897593 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:22.905524 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:22.906968 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:22.908170 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-30c1d070-9f9e-4079-9ef1-729ac9494b6c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.302452 Sep 13 06:48:22.908722 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 467/946] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:22 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:23.933342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:23.933953 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:23.940952 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:23.941446 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:23.941882 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:23.942578 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:23.943040 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:23.943499 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:24.044450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-2e8af7fb-d68c-4ebc-b3e5-1de59fee20c2 req-ad7ef2d2-e2bb-4ec0-8a14-dc02df927e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd984c2d-db41-44f6-9324-394602908a4b", "name": "network-vif-plugged", "status": "completed", "tag": "85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:48:24.061457 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-2e8af7fb-d68c-4ebc-b3e5-1de59fee20c2 req-ad7ef2d2-e2bb-4ec0-8a14-dc02df927e04 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:24.062011 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-2e8af7fb-d68c-4ebc-b3e5-1de59fee20c2 req-ad7ef2d2-e2bb-4ec0-8a14-dc02df927e04 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:24.062531 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-2e8af7fb-d68c-4ebc-b3e5-1de59fee20c2 req-ad7ef2d2-e2bb-4ec0-8a14-dc02df927e04 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:24.074105 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-2e8af7fb-d68c-4ebc-b3e5-1de59fee20c2 req-ad7ef2d2-e2bb-4ec0-8a14-dc02df927e04 service nova] Creating event network-vif-plugged:85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b for instance fd984c2d-db41-44f6-9324-394602908a4b on hv-cinder-85638 Sep 13 06:48:24.079255 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-2e8af7fb-d68c-4ebc-b3e5-1de59fee20c2 req-ad7ef2d2-e2bb-4ec0-8a14-dc02df927e04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097622 Sep 13 06:48:24.080272 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 468/947] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:48:24.085875 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:24.093947 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:24.095410 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:24.096552 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7336c99a-f20b-41f1-aacc-9bc3c03dcf88 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.167119 Sep 13 06:48:24.097095 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 480/948] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:23 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:25.122336 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:25.123018 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:25.129037 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:25.129517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:25.129947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:25.130623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:25.131083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:25.131528 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:25.257906 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:25.265938 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:25.267462 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:25.268613 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c3c24331-e332-41b5-a1bc-18a09fae28f3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.150938 Sep 13 06:48:25.269151 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 469/949] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:25 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:26.296322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:26.296950 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:26.303056 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:26.303653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:26.304095 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:26.305576 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:26.306099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:26.306526 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:26.434548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:26.442601 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:26.444079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:26.445248 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5823ec75-d57e-46d1-bf34-2ccb9e464301 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1745 microversion: 2.20 time: 0.153064 Sep 13 06:48:26.445803 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 481/950] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:26 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:27.470086 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:27.470718 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:27.478518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:27.479016 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:27.479509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:27.480207 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:27.480629 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:27.481054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:27.617130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:27.625195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:27.626644 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:27.627830 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ef6abb17-f97c-48a8-bd85-6525351f3fc7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.161674 Sep 13 06:48:27.628383 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 470/951] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:27 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:28.660265 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:28.661832 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:28.668577 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=27 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:28.680113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:28.681638 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:28.682466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:28.684240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:28.686077 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:28.687142 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:28.693996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=77 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:28.840898 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:28.849580 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:28.851053 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:28.852386 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-10f09fd7-f30e-40dd-824d-a4a868297bbe tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.200481 Sep 13 06:48:28.853240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 482/952] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:28 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:29.881913 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:29.883669 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:29.887141 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=29 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:29.891027 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:29.891590 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:29.892090 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:29.892788 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:29.893242 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:29.893668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:29.896975 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:30.046620 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:30.056379 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:30.058103 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:30.061284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ccb8cd21-f174-4bc1-abfa-3d9156d7cd5b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.183396 Sep 13 06:48:30.062278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 471/953] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:29 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:31.089370 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:31.089999 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:31.097457 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:31.098243 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:31.098688 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:31.099522 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:31.099992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:31.101811 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:31.260941 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:31.269816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:31.271287 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:31.272478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-58624c34-50fe-406e-ba28-e5369001e2c9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.187374 Sep 13 06:48:31.273046 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 483/954] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:31 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:32.299829 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:32.301364 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:32.308972 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:32.309770 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:32.310279 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:32.326583 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:32.327444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:32.328153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:32.510516 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:32.518688 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:32.520165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:32.521358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2cf60e1f-88f7-4158-b39a-d8f28b2dd556 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.225836 Sep 13 06:48:32.521955 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 472/955] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:32 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:33.548032 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:33.549324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:33.559290 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:33.562102 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:33.562763 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:33.564137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:33.565803 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:33.566434 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:33.730194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:33.738780 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:33.741449 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:33.743674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c3f7db02-f70c-474c-9d0a-50f7d7455448 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.200120 Sep 13 06:48:33.764932 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 484/956] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:33 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:34.770468 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:34.771062 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:34.778224 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:34.778704 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:34.779137 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:34.779856 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:34.780315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:34.780737 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:34.919377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:34.927304 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:34.928758 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:34.929955 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-275c7cc6-31c2-487b-9189-0ff79955c5d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.163513 Sep 13 06:48:34.930746 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 473/957] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:34 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:35.955879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:35.956449 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:35.964346 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:35.965130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:35.965742 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:35.966462 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:35.966911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:35.967326 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:36.110688 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:36.122922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:36.124390 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:36.125755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e3631fed-3cbe-4a7e-84c6-b56a3e8f202d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.174061 Sep 13 06:48:36.126612 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 485/958] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:35 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:37.154239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:37.155031 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:37.161766 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:37.162378 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:37.162887 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:37.163734 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:37.165226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:37.165732 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:37.321551 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:37.329597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:37.331056 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:37.332279 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-74e32ccf-96da-40e1-882e-d69b9d27f8e0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.182672 Sep 13 06:48:37.332840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 474/959] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:37 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:38.361097 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:38.361790 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:38.369568 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:38.370177 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:38.370715 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:38.371529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:38.372052 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:38.372570 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:38.516369 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:38.525801 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:38.527653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:38.528811 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d297c45b-d5e7-4623-91e4-316893c65bb4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.171547 Sep 13 06:48:38.543481 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 486/960] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:38 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:39.555596 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:39.556203 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:39.562220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:39.562705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:39.563142 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:39.563863 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:39.564322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:39.564749 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:39.770894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:39.778819 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:39.780303 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:39.781457 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-07277b40-fa83-4a7f-ac23-f0a78a1410e9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1740 microversion: 2.20 time: 0.231248 Sep 13 06:48:39.782007 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 475/961] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:39 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:40.808051 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:40.808686 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:40.814998 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:40.815509 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:40.815940 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:40.816627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:40.817126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:40.817550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:40.955110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:40.964130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:40.965635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:40.966891 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1ee24a20-e9b7-4b44-b998-94d9083048a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1722 microversion: 2.20 time: 0.163489 Sep 13 06:48:40.967483 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 487/962] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:40 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:48:41.992981 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:41.993584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:41.999815 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:42.000402 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:42.000732 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:42.001423 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:42.001873 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:42.002287 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:42.137905 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:42.146165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:42.147636 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:42.149478 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b839d69c-cc38-41d1-b7fd-dbe262d54ff7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1722 microversion: 2.20 time: 0.160365 Sep 13 06:48:42.150034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 476/963] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:41 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:43.085187 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-192b7da4-df47-49c2-87e9-7f33b2a6fdf8 req-d68d1830-e972-42d5-893b-3dd2b61d728c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd984c2d-db41-44f6-9324-394602908a4b", "name": "network-vif-unplugged", "status": "completed", "tag": "85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:48:43.107147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-192b7da4-df47-49c2-87e9-7f33b2a6fdf8 req-d68d1830-e972-42d5-893b-3dd2b61d728c service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:43.108185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-192b7da4-df47-49c2-87e9-7f33b2a6fdf8 req-d68d1830-e972-42d5-893b-3dd2b61d728c service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:43.108625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-192b7da4-df47-49c2-87e9-7f33b2a6fdf8 req-d68d1830-e972-42d5-893b-3dd2b61d728c service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:43.120376 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-192b7da4-df47-49c2-87e9-7f33b2a6fdf8 req-d68d1830-e972-42d5-893b-3dd2b61d728c service nova] Creating event network-vif-unplugged:85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b for instance fd984c2d-db41-44f6-9324-394602908a4b on hv-cinder-85638 Sep 13 06:48:43.126214 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-192b7da4-df47-49c2-87e9-7f33b2a6fdf8 req-d68d1830-e972-42d5-893b-3dd2b61d728c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050389 Sep 13 06:48:43.127113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 488/964] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:48:43.173967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:43.174568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:43.180912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:43.181403 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:43.181862 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:43.182607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:43.183085 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:43.183535 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:43.330283 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:43.340212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:43.341809 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:43.343246 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-91ff47de-a27d-4b41-b69f-3c7616f6f18e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1725 microversion: 2.20 time: 0.173141 Sep 13 06:48:43.343954 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 477/965] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:43 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:43.369347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3f4dafdb-23bb-43d4-becf-cdcfe35549ed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42a3f861-e969-4a22-af12-f2bc678f67dc"}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:48:43.371780 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3f4dafdb-23bb-43d4-becf-cdcfe35549ed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:43.378633 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f4dafdb-23bb-43d4-becf-cdcfe35549ed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:43.379229 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f4dafdb-23bb-43d4-becf-cdcfe35549ed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:43.379790 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f4dafdb-23bb-43d4-becf-cdcfe35549ed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:43.380499 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f4dafdb-23bb-43d4-becf-cdcfe35549ed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:43.380959 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f4dafdb-23bb-43d4-becf-cdcfe35549ed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:43.381406 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3f4dafdb-23bb-43d4-becf-cdcfe35549ed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:43.703502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3f4dafdb-23bb-43d4-becf-cdcfe35549ed tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "POST /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.338454 Sep 13 06:48:43.704668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 489/966] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Sep 13 06:48:43 2022] POST /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-volume_attachments => generated 188 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:43.840342 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-22f07aa5-68c7-4e18-b2fe-20ce5749d592 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:48:43.841093 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-22f07aa5-68c7-4e18-b2fe-20ce5749d592 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:43.848814 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22f07aa5-68c7-4e18-b2fe-20ce5749d592 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:43.849380 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22f07aa5-68c7-4e18-b2fe-20ce5749d592 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:43.849897 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22f07aa5-68c7-4e18-b2fe-20ce5749d592 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:43.850666 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22f07aa5-68c7-4e18-b2fe-20ce5749d592 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:43.851248 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22f07aa5-68c7-4e18-b2fe-20ce5749d592 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:43.851759 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-22f07aa5-68c7-4e18-b2fe-20ce5749d592 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:43.901133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-22f07aa5-68c7-4e18-b2fe-20ce5749d592 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132398) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 06:48:43.965012 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-22f07aa5-68c7-4e18-b2fe-20ce5749d592 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "POST /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/action" status: 202 len: 0 microversion: 2.20 time: 0.128641 Sep 13 06:48:43.965678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 478/967] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Sep 13 06:48:43 2022] POST /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:48:43.973861 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:43.976369 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:43.983803 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:43.984377 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:43.984908 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:43.985825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:43.986487 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:43.986992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:44.138490 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:44.148931 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:44.150375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:44.151578 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-45a6d1c1-fc3a-44bb-88de-24b83a484568 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1751 microversion: 2.20 time: 0.181622 Sep 13 06:48:44.152125 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 490/968] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:43 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:45.178101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:45.178753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:45.185901 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:45.186547 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:45.187053 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:45.187916 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:45.188373 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:45.188908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:45.239776 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-37b0dc63-b880-4814-b350-22fd85ccb0c5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:45.240362 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-37b0dc63-b880-4814-b350-22fd85ccb0c5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:45.246888 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37b0dc63-b880-4814-b350-22fd85ccb0c5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:45.247389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37b0dc63-b880-4814-b350-22fd85ccb0c5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:45.247829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37b0dc63-b880-4814-b350-22fd85ccb0c5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:45.248520 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37b0dc63-b880-4814-b350-22fd85ccb0c5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:45.248973 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37b0dc63-b880-4814-b350-22fd85ccb0c5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:45.250202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37b0dc63-b880-4814-b350-22fd85ccb0c5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:45.273712 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-37b0dc63-b880-4814-b350-22fd85ccb0c5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/ips" status: 200 len: 150 microversion: 2.1 time: 0.037790 Sep 13 06:48:45.274290 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 491/969] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Sep 13 06:48:45 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:48:45.319734 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:45.328866 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:45.330315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:45.331509 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5c8d4165-d4d9-4d2c-8e6d-b0d36436a39d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1751 microversion: 2.20 time: 0.158159 Sep 13 06:48:45.332064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 479/970] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:45 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:46.358436 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:46.359050 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:46.365536 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:46.366020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:46.366495 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:46.367548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:46.368096 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:46.368743 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:46.502201 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:46.512082 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:46.513553 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:46.514689 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9d5af8c0-6c48-4f11-9136-133037a40c43 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1751 microversion: 2.20 time: 0.160153 Sep 13 06:48:46.515275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 492/971] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:46 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:46.614764 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-049b94f6-3d5a-487b-8201-4eeac0609ce2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4cbc764-fe3d-4af4-b983-fe255021ab4a"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:48:46.617258 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-049b94f6-3d5a-487b-8201-4eeac0609ce2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:46.623613 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-049b94f6-3d5a-487b-8201-4eeac0609ce2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:46.624104 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-049b94f6-3d5a-487b-8201-4eeac0609ce2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:46.624546 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-049b94f6-3d5a-487b-8201-4eeac0609ce2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:46.625242 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-049b94f6-3d5a-487b-8201-4eeac0609ce2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:46.625705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-049b94f6-3d5a-487b-8201-4eeac0609ce2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:46.626136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-049b94f6-3d5a-487b-8201-4eeac0609ce2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:46.907168 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-049b94f6-3d5a-487b-8201-4eeac0609ce2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "POST /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296202 Sep 13 06:48:46.908020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 480/972] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Sep 13 06:48:46 2022] POST /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:48:47.541536 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:47.542242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:47.548537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:47.549024 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:47.549455 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:47.550145 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:47.550597 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:47.551015 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:47.696702 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:47.705594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:47.707128 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:47.708403 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-578b96e0-b701-43a0-b587-8f51d68b905e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1751 microversion: 2.20 time: 0.171579 Sep 13 06:48:47.709047 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 493/973] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:47 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:48.736228 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:48.736970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:48.744666 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:48.745299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:48.745949 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:48.746790 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:48.747256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:48.747715 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:48.882664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:48.892405 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:48.893855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:48.895032 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e52ce699-70ae-4789-9254-45634b859ff3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1751 microversion: 2.20 time: 0.163270 Sep 13 06:48:48.895585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 481/974] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:48 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:49.922268 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:49.922866 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:49.930064 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:49.930537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:49.930961 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:49.931686 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:49.932135 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:49.932560 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:50.064579 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:50.073338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:50.074786 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:50.075973 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-324e7c3a-e4d1-430b-b120-dc9b24401add tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1753 microversion: 2.20 time: 0.157627 Sep 13 06:48:50.076525 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 494/975] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:49 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:51.103683 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:51.104292 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:51.110692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:51.111253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:51.111734 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:51.112428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:51.112880 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:51.113299 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:51.261350 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:51.269918 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:51.271383 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:51.272550 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2462706f-7fc4-42bc-a1ae-75dc8e87bec3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1753 microversion: 2.20 time: 0.172830 Sep 13 06:48:51.273181 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 482/976] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:51 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:52.300465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:52.301981 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:52.312226 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:52.312527 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:52.312971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:52.313681 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:52.314139 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:52.314565 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:52.496408 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:52.505414 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:52.506858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:52.508608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-89b6e960-9db5-4130-9470-49ab4a145422 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1753 microversion: 2.20 time: 0.212920 Sep 13 06:48:52.509220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 495/977] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:52 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1753 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:53.534309 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:53.535691 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:53.542938 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:53.543623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:53.544163 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:53.545066 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:53.545528 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:53.545961 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:53.678731 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:53.687604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:53.689048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:53.690223 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ca9ff442-cf6a-4960-8e8f-0fc966dfc1cd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1753 microversion: 2.20 time: 0.160122 Sep 13 06:48:53.690782 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 483/978] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:53 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:54.564484 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d2e10298-da7a-4fe2-ab05-2724cc0cf305 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:54.564996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d2e10298-da7a-4fe2-ab05-2724cc0cf305 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:54.571982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d2e10298-da7a-4fe2-ab05-2724cc0cf305 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:54.572457 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d2e10298-da7a-4fe2-ab05-2724cc0cf305 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:54.572886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d2e10298-da7a-4fe2-ab05-2724cc0cf305 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:54.573567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d2e10298-da7a-4fe2-ab05-2724cc0cf305 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:54.574018 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d2e10298-da7a-4fe2-ab05-2724cc0cf305 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:54.574437 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d2e10298-da7a-4fe2-ab05-2724cc0cf305 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:54.656827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.objects.instance [None req-d2e10298-da7a-4fe2-ab05-2724cc0cf305 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lazy-loading 'services' on Instance uuid 60a787fe-2c12-4673-a5c5-deaf07aecbe5 {{(pid=132399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:48:54.663042 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:54.716788 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:54.717427 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:54.728255 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:54.728911 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:54.729991 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:54.730256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:54.730843 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:54.731511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:54.739382 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d2e10298-da7a-4fe2-ab05-2724cc0cf305 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-volume_attachments/c4cbc764-fe3d-4af4-b983-fe255021ab4a" status: 202 len: 0 microversion: 2.1 time: 0.178651 Sep 13 06:48:54.743147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 496/979] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Sep 13 06:48:54 2022] DELETE /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-volume_attachments/c4cbc764-fe3d-4af4-b983-fe255021ab4a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:48:54.748557 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0e634e77-a418-4689-82ab-125a3da4c667 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:54.750906 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0e634e77-a418-4689-82ab-125a3da4c667 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:54.758113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e634e77-a418-4689-82ab-125a3da4c667 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:54.758744 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e634e77-a418-4689-82ab-125a3da4c667 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:54.759180 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e634e77-a418-4689-82ab-125a3da4c667 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:54.760057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e634e77-a418-4689-82ab-125a3da4c667 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:54.760575 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e634e77-a418-4689-82ab-125a3da4c667 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:54.761022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e634e77-a418-4689-82ab-125a3da4c667 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:54.796704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0e634e77-a418-4689-82ab-125a3da4c667 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051880 Sep 13 06:48:54.798175 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 497/980] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:48:54 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:48:54.889948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:54.900199 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:54.901650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:54.903041 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-aa6bd8f1-16bd-4cb2-b8a2-2342ab8a1abd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1753 microversion: 2.20 time: 0.191129 Sep 13 06:48:54.903784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 484/981] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:54 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:48:55.809960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-de8c1f98-a062-4f20-a119-fd70662c3703 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:55.812272 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-de8c1f98-a062-4f20-a119-fd70662c3703 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:55.818472 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de8c1f98-a062-4f20-a119-fd70662c3703 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:55.818959 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de8c1f98-a062-4f20-a119-fd70662c3703 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:55.819473 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de8c1f98-a062-4f20-a119-fd70662c3703 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:55.820160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de8c1f98-a062-4f20-a119-fd70662c3703 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:55.820620 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de8c1f98-a062-4f20-a119-fd70662c3703 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:55.821042 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-de8c1f98-a062-4f20-a119-fd70662c3703 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:55.855588 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-de8c1f98-a062-4f20-a119-fd70662c3703 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049327 Sep 13 06:48:55.856075 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 498/982] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:48:55 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:48:55.930417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:55.931022 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:55.937529 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:55.938017 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:55.938457 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:55.939147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:55.939668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:55.940099 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:55.955307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:56.081444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:56.090984 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:56.093549 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:56.095298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b8d99962-a5c6-4529-8d08-4594f79d3f70 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.169022 Sep 13 06:48:56.095889 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 485/983] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:55 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:56.868548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-52c5cc73-2e00-4119-83fb-24f1feb6e95a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:56.870822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-52c5cc73-2e00-4119-83fb-24f1feb6e95a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:56.877391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-52c5cc73-2e00-4119-83fb-24f1feb6e95a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:56.877882 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-52c5cc73-2e00-4119-83fb-24f1feb6e95a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:56.878311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-52c5cc73-2e00-4119-83fb-24f1feb6e95a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:56.879013 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-52c5cc73-2e00-4119-83fb-24f1feb6e95a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:56.879531 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-52c5cc73-2e00-4119-83fb-24f1feb6e95a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:56.879964 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-52c5cc73-2e00-4119-83fb-24f1feb6e95a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:56.910805 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-52c5cc73-2e00-4119-83fb-24f1feb6e95a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046804 Sep 13 06:48:56.911388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 499/984] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Sep 13 06:48:56 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 06:48:56.979025 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d9808d09-79f0-4ce0-96e6-84cb1299003e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:56.979804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d9808d09-79f0-4ce0-96e6-84cb1299003e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:56.987681 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d9808d09-79f0-4ce0-96e6-84cb1299003e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:56.988204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d9808d09-79f0-4ce0-96e6-84cb1299003e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:56.988644 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d9808d09-79f0-4ce0-96e6-84cb1299003e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:56.989351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d9808d09-79f0-4ce0-96e6-84cb1299003e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:56.990336 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d9808d09-79f0-4ce0-96e6-84cb1299003e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:56.990774 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d9808d09-79f0-4ce0-96e6-84cb1299003e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:57.017055 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d9808d09-79f0-4ce0-96e6-84cb1299003e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Going to try to terminate instance {{(pid=132398) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:48:57.098512 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d9808d09-79f0-4ce0-96e6-84cb1299003e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 204 len: 0 microversion: 2.1 time: 0.124237 Sep 13 06:48:57.099531 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 486/985] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:48:56 2022] DELETE /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:48:57.108440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d82562ed-616a-4ddf-a1a7-61c5bdb7ffb0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:57.109139 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d82562ed-616a-4ddf-a1a7-61c5bdb7ffb0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:57.115186 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d82562ed-616a-4ddf-a1a7-61c5bdb7ffb0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:57.115803 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d82562ed-616a-4ddf-a1a7-61c5bdb7ffb0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:57.116245 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d82562ed-616a-4ddf-a1a7-61c5bdb7ffb0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:57.117654 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d82562ed-616a-4ddf-a1a7-61c5bdb7ffb0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:57.118184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d82562ed-616a-4ddf-a1a7-61c5bdb7ffb0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:57.118684 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d82562ed-616a-4ddf-a1a7-61c5bdb7ffb0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:57.124889 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:57.125597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:57.132254 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:57.132737 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:57.133172 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:57.135398 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:57.135885 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:57.136492 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:57.290996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:57.299177 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d82562ed-616a-4ddf-a1a7-61c5bdb7ffb0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:57.301053 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:57.302581 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:57.304127 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f0a24e55-28ed-481e-857c-6437176c2966 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.184364 Sep 13 06:48:57.316216 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 487/986] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:57 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:48:57.321382 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d82562ed-616a-4ddf-a1a7-61c5bdb7ffb0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.217024 Sep 13 06:48:57.322391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 500/987] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:48:57 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:48:58.331254 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:58.331990 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:58.340363 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:58.340853 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:58.341290 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:58.342017 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:58.342470 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:58.342893 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:58.346238 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f1c484cb-2e01-4526-be9e-36763f52be3d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:58.346849 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f1c484cb-2e01-4526-be9e-36763f52be3d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:58.353297 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f1c484cb-2e01-4526-be9e-36763f52be3d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:58.353779 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f1c484cb-2e01-4526-be9e-36763f52be3d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:58.354209 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f1c484cb-2e01-4526-be9e-36763f52be3d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:58.354901 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f1c484cb-2e01-4526-be9e-36763f52be3d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:58.355489 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f1c484cb-2e01-4526-be9e-36763f52be3d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:58.355916 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f1c484cb-2e01-4526-be9e-36763f52be3d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:58.481064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:58.489727 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:58.491407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:58.492625 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8c5e2e31-caf7-4294-a588-b9cb04c074b0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.165269 Sep 13 06:48:58.493224 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 488/988] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:58 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:48:58.497558 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f1c484cb-2e01-4526-be9e-36763f52be3d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:58.505890 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f1c484cb-2e01-4526-be9e-36763f52be3d tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.163854 Sep 13 06:48:58.506449 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 501/989] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:48:58 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:48:59.524998 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:59.525725 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:59.530058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f84545cb-1adb-4386-987c-cbbea086b304 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:48:59.531329 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f84545cb-1adb-4386-987c-cbbea086b304 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:48:59.532301 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:59.532788 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:59.533228 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:59.533932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:59.534381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:59.534683 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=40 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:59.534861 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:59.541253 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f84545cb-1adb-4386-987c-cbbea086b304 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:59.541732 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f84545cb-1adb-4386-987c-cbbea086b304 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:59.542170 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f84545cb-1adb-4386-987c-cbbea086b304 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:59.542873 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f84545cb-1adb-4386-987c-cbbea086b304 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:48:59.543325 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f84545cb-1adb-4386-987c-cbbea086b304 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:48:59.543778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f84545cb-1adb-4386-987c-cbbea086b304 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:48:59.707674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f84545cb-1adb-4386-987c-cbbea086b304 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:59.712141 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:59.721412 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:59.722601 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f84545cb-1adb-4386-987c-cbbea086b304 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.196664 Sep 13 06:48:59.722862 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:48:59.723181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 502/990] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:48:59 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:48:59.724098 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1e148dad-3442-4c21-ae66-19022af2c30a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.203673 Sep 13 06:48:59.724653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 489/991] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:48:59 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:00.747107 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b4fe9f0a-9374-4a9d-9a44-39addf8f85fa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:00.747997 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b4fe9f0a-9374-4a9d-9a44-39addf8f85fa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:00.750151 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:00.750759 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:00.753129 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:00.754788 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b4fe9f0a-9374-4a9d-9a44-39addf8f85fa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:00.755341 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b4fe9f0a-9374-4a9d-9a44-39addf8f85fa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:00.755871 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b4fe9f0a-9374-4a9d-9a44-39addf8f85fa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:00.756630 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b4fe9f0a-9374-4a9d-9a44-39addf8f85fa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:00.757195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b4fe9f0a-9374-4a9d-9a44-39addf8f85fa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:00.757678 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b4fe9f0a-9374-4a9d-9a44-39addf8f85fa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:00.758147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:00.758628 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:00.759064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:00.759786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:00.760245 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:00.760673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:00.897063 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b4fe9f0a-9374-4a9d-9a44-39addf8f85fa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:00.906228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b4fe9f0a-9374-4a9d-9a44-39addf8f85fa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.162933 Sep 13 06:49:00.910257 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 503/992] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:00 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:00.936315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:00.945117 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:00.946654 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:00.947876 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ff5bea21-b2f8-4133-b46e-fd5622407245 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.201524 Sep 13 06:49:00.948437 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 490/993] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:00 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:01.930670 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5fed47d9-3165-42fe-acf1-9ce8bdc97b40 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:01.932069 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5fed47d9-3165-42fe-acf1-9ce8bdc97b40 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:01.939334 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fed47d9-3165-42fe-acf1-9ce8bdc97b40 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:01.940194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fed47d9-3165-42fe-acf1-9ce8bdc97b40 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:01.940874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fed47d9-3165-42fe-acf1-9ce8bdc97b40 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:01.941823 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fed47d9-3165-42fe-acf1-9ce8bdc97b40 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:01.942507 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fed47d9-3165-42fe-acf1-9ce8bdc97b40 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:01.943142 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fed47d9-3165-42fe-acf1-9ce8bdc97b40 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:01.973706 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:01.974319 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:01.980947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:01.981442 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:01.981882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:01.982586 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:01.983049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:01.983539 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:02.099813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5fed47d9-3165-42fe-acf1-9ce8bdc97b40 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:02.108189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5fed47d9-3165-42fe-acf1-9ce8bdc97b40 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.181838 Sep 13 06:49:02.109919 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 504/994] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:01 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:02.141524 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:02.153218 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:02.154678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:02.156089 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f466c460-baac-4b65-b7f3-fe8f33b9a092 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.186330 Sep 13 06:49:02.156659 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 491/995] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:01 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:49:03.133642 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-78acda66-ead7-4f37-9e88-cd3d6bf9152f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:03.134257 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-78acda66-ead7-4f37-9e88-cd3d6bf9152f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:03.140562 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78acda66-ead7-4f37-9e88-cd3d6bf9152f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:03.141053 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78acda66-ead7-4f37-9e88-cd3d6bf9152f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:03.141488 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78acda66-ead7-4f37-9e88-cd3d6bf9152f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:03.142227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78acda66-ead7-4f37-9e88-cd3d6bf9152f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:03.142685 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78acda66-ead7-4f37-9e88-cd3d6bf9152f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:03.143111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-78acda66-ead7-4f37-9e88-cd3d6bf9152f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:03.183054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:03.184549 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:03.192042 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:03.192627 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:03.193209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:03.194037 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:03.195152 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:03.195909 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:03.307955 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-78acda66-ead7-4f37-9e88-cd3d6bf9152f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:03.319430 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-78acda66-ead7-4f37-9e88-cd3d6bf9152f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.190010 Sep 13 06:49:03.320851 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 505/996] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:03 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:03.367257 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:03.376308 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:03.377767 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:03.378949 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ae892dbd-2a45-4dfa-905d-cd868d3cbec7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.200554 Sep 13 06:49:03.379541 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 492/997] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:03 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:04.344539 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7ea2f96a-58ec-4335-b17a-7872877477e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:04.345147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7ea2f96a-58ec-4335-b17a-7872877477e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:04.351590 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7ea2f96a-58ec-4335-b17a-7872877477e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:04.352084 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7ea2f96a-58ec-4335-b17a-7872877477e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:04.352502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7ea2f96a-58ec-4335-b17a-7872877477e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:04.353195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7ea2f96a-58ec-4335-b17a-7872877477e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:04.353642 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7ea2f96a-58ec-4335-b17a-7872877477e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:04.354055 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7ea2f96a-58ec-4335-b17a-7872877477e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:04.405302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:04.407238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:04.420275 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:04.423833 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:04.424382 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:04.425396 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:04.426529 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:04.427204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:04.526198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7ea2f96a-58ec-4335-b17a-7872877477e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:04.534217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7ea2f96a-58ec-4335-b17a-7872877477e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.193489 Sep 13 06:49:04.534786 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 506/998] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:04 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:04.592608 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:04.602397 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:04.604014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:04.605335 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3a1032d2-601e-4ed1-ba65-1fa3a87547bd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.203996 Sep 13 06:49:04.605989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 493/999] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:04 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:49:05.559787 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d186a5df-2d7c-4ddd-9a29-479cca4dd8aa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:05.560403 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d186a5df-2d7c-4ddd-9a29-479cca4dd8aa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:05.567200 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d186a5df-2d7c-4ddd-9a29-479cca4dd8aa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:05.567720 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d186a5df-2d7c-4ddd-9a29-479cca4dd8aa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:05.568151 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d186a5df-2d7c-4ddd-9a29-479cca4dd8aa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:05.568845 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d186a5df-2d7c-4ddd-9a29-479cca4dd8aa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:05.569295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d186a5df-2d7c-4ddd-9a29-479cca4dd8aa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:05.569719 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d186a5df-2d7c-4ddd-9a29-479cca4dd8aa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:05.630207 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:05.630974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:05.639209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:05.639726 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:05.640187 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:05.640926 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:05.641400 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:05.641952 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:05.713405 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d186a5df-2d7c-4ddd-9a29-479cca4dd8aa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:05.722330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d186a5df-2d7c-4ddd-9a29-479cca4dd8aa tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.166462 Sep 13 06:49:05.722944 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 507/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:05 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:05.804732 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:05.814183 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:05.815676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:05.816961 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c4451ff2-7452-4fce-b311-a0b44a7c94d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.190768 Sep 13 06:49:05.817516 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 494/1001] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:05 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:49:06.746829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fd5ec707-6704-4dab-85ee-915cf7cdc0e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:06.747704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-fd5ec707-6704-4dab-85ee-915cf7cdc0e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:06.754049 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd5ec707-6704-4dab-85ee-915cf7cdc0e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:06.754625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd5ec707-6704-4dab-85ee-915cf7cdc0e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:06.755133 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd5ec707-6704-4dab-85ee-915cf7cdc0e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:06.756098 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd5ec707-6704-4dab-85ee-915cf7cdc0e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:06.756616 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd5ec707-6704-4dab-85ee-915cf7cdc0e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:06.757222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd5ec707-6704-4dab-85ee-915cf7cdc0e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:06.842835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:06.844102 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:06.851718 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:06.852652 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:06.853180 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:06.853971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:06.854511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:06.855016 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:06.899453 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fd5ec707-6704-4dab-85ee-915cf7cdc0e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:06.908229 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fd5ec707-6704-4dab-85ee-915cf7cdc0e6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.166191 Sep 13 06:49:06.909609 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 508/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:06 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:07.026931 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:07.035553 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:07.036994 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:07.038141 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3861e9e9-a89c-47f8-b83e-2f786df5d487 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.199203 Sep 13 06:49:07.038733 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 495/1003] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:06 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:49:07.939460 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5170b167-d389-4850-8bc1-e0a80cb471cc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:07.940086 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5170b167-d389-4850-8bc1-e0a80cb471cc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:07.946350 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5170b167-d389-4850-8bc1-e0a80cb471cc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:07.946831 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5170b167-d389-4850-8bc1-e0a80cb471cc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:07.947262 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5170b167-d389-4850-8bc1-e0a80cb471cc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:07.947972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5170b167-d389-4850-8bc1-e0a80cb471cc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:07.948516 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5170b167-d389-4850-8bc1-e0a80cb471cc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:07.949002 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5170b167-d389-4850-8bc1-e0a80cb471cc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:08.063788 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:08.065050 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:08.072922 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:08.073711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:08.074337 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:08.075052 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:08.075544 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:08.075973 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:08.229813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:08.238768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:08.240304 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:08.241797 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4105918e-9c57-41bc-b52c-fdcdcfd56cf5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.182026 Sep 13 06:49:08.242543 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 496/1004] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:08 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:49:08.337933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5170b167-d389-4850-8bc1-e0a80cb471cc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:08.346635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5170b167-d389-4850-8bc1-e0a80cb471cc tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.411235 Sep 13 06:49:08.347579 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 509/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:07 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:09.269385 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:09.269962 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:09.276312 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:09.276799 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:09.277235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:09.277928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:09.278390 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:09.278817 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:09.369399 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-18cb1d1c-921c-490b-bc64-ec337f9c6f94 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:09.370004 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-18cb1d1c-921c-490b-bc64-ec337f9c6f94 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:09.376279 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18cb1d1c-921c-490b-bc64-ec337f9c6f94 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:09.376752 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18cb1d1c-921c-490b-bc64-ec337f9c6f94 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:09.377181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18cb1d1c-921c-490b-bc64-ec337f9c6f94 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:09.377860 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18cb1d1c-921c-490b-bc64-ec337f9c6f94 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:09.378307 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18cb1d1c-921c-490b-bc64-ec337f9c6f94 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:09.378721 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-18cb1d1c-921c-490b-bc64-ec337f9c6f94 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:09.409007 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:09.418111 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:09.419592 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:09.420786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3cffdf8b-0446-44ae-b24d-618d8a81bc1d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.155752 Sep 13 06:49:09.421354 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 497/1006] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:09 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:09.506090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-18cb1d1c-921c-490b-bc64-ec337f9c6f94 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:09.514282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-18cb1d1c-921c-490b-bc64-ec337f9c6f94 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.149214 Sep 13 06:49:09.514844 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 510/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:09 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:10.446460 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:10.447074 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:10.453469 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:10.453954 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:10.454393 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:10.455085 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:10.455574 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:10.456003 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:10.537465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6302e0d4-5b23-489b-8c14-99d6f75032f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:10.538076 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6302e0d4-5b23-489b-8c14-99d6f75032f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:10.545308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6302e0d4-5b23-489b-8c14-99d6f75032f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:10.545787 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6302e0d4-5b23-489b-8c14-99d6f75032f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:10.546219 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6302e0d4-5b23-489b-8c14-99d6f75032f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:10.546912 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6302e0d4-5b23-489b-8c14-99d6f75032f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:10.547423 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6302e0d4-5b23-489b-8c14-99d6f75032f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:10.547849 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6302e0d4-5b23-489b-8c14-99d6f75032f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:10.585854 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:10.594915 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:10.596390 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:10.597566 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-304c434b-227c-4086-8b81-48445802596c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.155030 Sep 13 06:49:10.598224 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 498/1008] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:10 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:10.678446 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6302e0d4-5b23-489b-8c14-99d6f75032f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:10.686180 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6302e0d4-5b23-489b-8c14-99d6f75032f6 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.152566 Sep 13 06:49:10.686755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 511/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:10 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:11.623283 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:11.623883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:11.630260 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:11.630749 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:11.631188 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:11.631925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:11.632388 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:11.632817 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:11.709240 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0a5502d4-b223-46d9-94fe-aedd5013f426 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:11.709901 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0a5502d4-b223-46d9-94fe-aedd5013f426 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:11.716817 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5502d4-b223-46d9-94fe-aedd5013f426 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:11.717306 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5502d4-b223-46d9-94fe-aedd5013f426 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:11.717741 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5502d4-b223-46d9-94fe-aedd5013f426 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:11.718441 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5502d4-b223-46d9-94fe-aedd5013f426 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:11.718897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5502d4-b223-46d9-94fe-aedd5013f426 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:11.719321 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0a5502d4-b223-46d9-94fe-aedd5013f426 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:11.760250 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:11.768930 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:11.770370 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:11.771574 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2c052ee0-da88-4ff5-8276-35cf519ec008 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.152290 Sep 13 06:49:11.772146 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 499/1010] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:11 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:11.847223 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0a5502d4-b223-46d9-94fe-aedd5013f426 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:11.854952 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0a5502d4-b223-46d9-94fe-aedd5013f426 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.149672 Sep 13 06:49:11.855552 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 512/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:11 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:12.798008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:12.798618 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:12.805806 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:12.806294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:12.806732 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:12.807457 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:12.807917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:12.808340 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:12.822894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:12.878109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6a37a168-9635-4706-bd2e-def9e2daf98e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:12.878657 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6a37a168-9635-4706-bd2e-def9e2daf98e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:12.884945 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6a37a168-9635-4706-bd2e-def9e2daf98e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:12.885421 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6a37a168-9635-4706-bd2e-def9e2daf98e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:12.885849 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6a37a168-9635-4706-bd2e-def9e2daf98e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:12.886536 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6a37a168-9635-4706-bd2e-def9e2daf98e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:12.886984 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6a37a168-9635-4706-bd2e-def9e2daf98e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:12.887425 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6a37a168-9635-4706-bd2e-def9e2daf98e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:12.889959 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:12.942325 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:12.951056 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:12.952580 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:12.953752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0b5fcc3c-30ba-448d-8aed-4feba40bfe79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.159758 Sep 13 06:49:12.954312 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 500/1012] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:12 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:13.021773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6a37a168-9635-4706-bd2e-def9e2daf98e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:13.030149 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6a37a168-9635-4706-bd2e-def9e2daf98e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.155969 Sep 13 06:49:13.030746 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 513/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:12 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:13.979690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:13.980307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:13.986722 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:13.987208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:13.987679 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:13.988377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:13.988839 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:13.989270 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:14.054692 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c1ec5393-8829-4ea1-8e2a-19098de7f680 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:14.055420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c1ec5393-8829-4ea1-8e2a-19098de7f680 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:14.061804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c1ec5393-8829-4ea1-8e2a-19098de7f680 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:14.062277 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c1ec5393-8829-4ea1-8e2a-19098de7f680 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:14.062710 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c1ec5393-8829-4ea1-8e2a-19098de7f680 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:14.063418 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c1ec5393-8829-4ea1-8e2a-19098de7f680 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:14.063872 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c1ec5393-8829-4ea1-8e2a-19098de7f680 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:14.064287 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c1ec5393-8829-4ea1-8e2a-19098de7f680 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:14.126122 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:14.134912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:14.136366 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:14.137523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c6cc3c5a-d9e6-4165-ab03-2b1c1a9f5d40 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.161955 Sep 13 06:49:14.138080 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 501/1014] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:13 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:14.198652 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c1ec5393-8829-4ea1-8e2a-19098de7f680 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:14.206339 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c1ec5393-8829-4ea1-8e2a-19098de7f680 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.156187 Sep 13 06:49:14.206899 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 514/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:14 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:15.161905 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:15.162511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:15.169093 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:15.169577 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:15.170013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:15.170696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:15.171151 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:15.171610 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:15.230268 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c210cbb2-9b5a-4b3e-b249-3bd1eb7f53de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:15.231009 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c210cbb2-9b5a-4b3e-b249-3bd1eb7f53de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:15.237558 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c210cbb2-9b5a-4b3e-b249-3bd1eb7f53de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:15.238045 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c210cbb2-9b5a-4b3e-b249-3bd1eb7f53de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:15.238478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c210cbb2-9b5a-4b3e-b249-3bd1eb7f53de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:15.239175 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c210cbb2-9b5a-4b3e-b249-3bd1eb7f53de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:15.239668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c210cbb2-9b5a-4b3e-b249-3bd1eb7f53de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:15.240097 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c210cbb2-9b5a-4b3e-b249-3bd1eb7f53de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:15.303171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:15.312465 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:15.313908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:15.315069 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6d157cc8-65a4-4ee6-b355-12a8bc852ddb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.157020 Sep 13 06:49:15.315657 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 502/1016] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:15 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:15.379816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c210cbb2-9b5a-4b3e-b249-3bd1eb7f53de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:15.387935 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c210cbb2-9b5a-4b3e-b249-3bd1eb7f53de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.162338 Sep 13 06:49:15.388528 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 515/1017] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:15 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:16.340121 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:16.340743 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:16.347043 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:16.347558 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:16.347989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:16.348669 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:16.349122 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:16.349543 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:16.411944 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-38e1492f-7237-441c-8077-f1548cdf06de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:16.412638 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-38e1492f-7237-441c-8077-f1548cdf06de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:16.419804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38e1492f-7237-441c-8077-f1548cdf06de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:16.420282 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38e1492f-7237-441c-8077-f1548cdf06de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:16.420710 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38e1492f-7237-441c-8077-f1548cdf06de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:16.421398 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38e1492f-7237-441c-8077-f1548cdf06de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:16.421841 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38e1492f-7237-441c-8077-f1548cdf06de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:16.422311 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-38e1492f-7237-441c-8077-f1548cdf06de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:16.481635 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:16.490091 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:16.492127 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:16.493310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-74f513d6-dbf3-4653-b47e-960393898e66 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.157164 Sep 13 06:49:16.493875 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 503/1018] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:16 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:16.552543 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-38e1492f-7237-441c-8077-f1548cdf06de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:16.560849 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-38e1492f-7237-441c-8077-f1548cdf06de tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.152757 Sep 13 06:49:16.561415 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 516/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:16 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:17.518853 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:17.519479 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:17.525844 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:17.526353 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:17.526789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:17.527499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:17.527960 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:17.528378 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:17.583248 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-cf220acb-c7de-4551-b179-4a4e10ed7ead tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:17.583931 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-cf220acb-c7de-4551-b179-4a4e10ed7ead tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:17.590230 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf220acb-c7de-4551-b179-4a4e10ed7ead tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:17.590714 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf220acb-c7de-4551-b179-4a4e10ed7ead tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:17.591142 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf220acb-c7de-4551-b179-4a4e10ed7ead tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:17.591869 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf220acb-c7de-4551-b179-4a4e10ed7ead tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:17.592320 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf220acb-c7de-4551-b179-4a4e10ed7ead tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:17.592764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cf220acb-c7de-4551-b179-4a4e10ed7ead tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:17.657195 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:17.666070 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:17.667542 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:17.668705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-549032d6-b1cc-46e5-91d2-e99b0aede5cc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.154138 Sep 13 06:49:17.669740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 504/1020] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:17 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:49:17.721189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-cf220acb-c7de-4551-b179-4a4e10ed7ead tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:17.728856 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-cf220acb-c7de-4551-b179-4a4e10ed7ead tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.149493 Sep 13 06:49:17.729420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 517/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:17 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:18.694995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:18.695635 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:18.702008 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:18.702493 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:18.702932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:18.703652 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:18.704115 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:18.704543 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:18.752401 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-12c03ddf-1ceb-43b5-8510-b5aaf8fabce0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:18.753034 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-12c03ddf-1ceb-43b5-8510-b5aaf8fabce0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:18.759920 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-12c03ddf-1ceb-43b5-8510-b5aaf8fabce0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:18.760408 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-12c03ddf-1ceb-43b5-8510-b5aaf8fabce0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:18.760838 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-12c03ddf-1ceb-43b5-8510-b5aaf8fabce0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:18.761534 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-12c03ddf-1ceb-43b5-8510-b5aaf8fabce0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:18.761992 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-12c03ddf-1ceb-43b5-8510-b5aaf8fabce0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:18.762412 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-12c03ddf-1ceb-43b5-8510-b5aaf8fabce0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:18.838690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:18.847851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:18.849320 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:18.850695 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7cf38657-0aa8-473f-913d-7ce69025e7fc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.160040 Sep 13 06:49:18.851254 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 505/1022] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:18 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:18.894224 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-12c03ddf-1ceb-43b5-8510-b5aaf8fabce0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:18.901955 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-12c03ddf-1ceb-43b5-8510-b5aaf8fabce0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.153420 Sep 13 06:49:18.902519 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 518/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:18 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:19.876295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:19.876927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:19.883220 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:19.883745 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:19.884166 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:19.884850 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:19.885302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:19.885723 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:19.924865 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-34570bde-6f60-4014-9e90-996d84d2f519 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:19.925477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-34570bde-6f60-4014-9e90-996d84d2f519 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:19.932006 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-34570bde-6f60-4014-9e90-996d84d2f519 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:19.932493 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-34570bde-6f60-4014-9e90-996d84d2f519 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:19.933060 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-34570bde-6f60-4014-9e90-996d84d2f519 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:19.933758 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-34570bde-6f60-4014-9e90-996d84d2f519 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:19.934236 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-34570bde-6f60-4014-9e90-996d84d2f519 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:19.934656 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-34570bde-6f60-4014-9e90-996d84d2f519 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:20.013850 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:20.023109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:20.024614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:20.025782 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9993f1a3-3594-40f0-bcfd-1755fbe87eff tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.153513 Sep 13 06:49:20.026351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 506/1024] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:19 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:20.064969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-34570bde-6f60-4014-9e90-996d84d2f519 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:20.073102 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-34570bde-6f60-4014-9e90-996d84d2f519 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.152179 Sep 13 06:49:20.073663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 519/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:19 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:21.051403 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:21.052042 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:21.059463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:21.059945 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:21.060379 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:21.061061 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:21.061515 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:21.061942 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:21.096790 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1cb07b24-7711-4cf3-86f3-e092e8db0821 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:21.097516 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1cb07b24-7711-4cf3-86f3-e092e8db0821 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:21.105119 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cb07b24-7711-4cf3-86f3-e092e8db0821 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:21.105734 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cb07b24-7711-4cf3-86f3-e092e8db0821 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:21.106219 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cb07b24-7711-4cf3-86f3-e092e8db0821 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:21.106924 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cb07b24-7711-4cf3-86f3-e092e8db0821 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:21.107398 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cb07b24-7711-4cf3-86f3-e092e8db0821 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:21.107829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1cb07b24-7711-4cf3-86f3-e092e8db0821 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:21.252815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1cb07b24-7711-4cf3-86f3-e092e8db0821 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:21.261893 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1cb07b24-7711-4cf3-86f3-e092e8db0821 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.168931 Sep 13 06:49:21.262625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 520/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:21 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:21.454165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:21.463242 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:21.464856 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:21.466016 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-f8e418d0-9232-42e9-b5af-b0751429bc1f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.418522 Sep 13 06:49:21.466568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 507/1027] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:21 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:22.287035 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-082e70fd-7f69-4dda-817f-ac3ba4f249ca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:22.287748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-082e70fd-7f69-4dda-817f-ac3ba4f249ca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:22.294800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-082e70fd-7f69-4dda-817f-ac3ba4f249ca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:22.295272 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-082e70fd-7f69-4dda-817f-ac3ba4f249ca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:22.295747 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-082e70fd-7f69-4dda-817f-ac3ba4f249ca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:22.296429 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-082e70fd-7f69-4dda-817f-ac3ba4f249ca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:22.296934 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-082e70fd-7f69-4dda-817f-ac3ba4f249ca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:22.297353 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-082e70fd-7f69-4dda-817f-ac3ba4f249ca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:22.434947 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-082e70fd-7f69-4dda-817f-ac3ba4f249ca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:22.442683 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-082e70fd-7f69-4dda-817f-ac3ba4f249ca tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1682 microversion: 2.1 time: 0.159575 Sep 13 06:49:22.443252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 521/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:22 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:22.494059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:22.494669 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:22.501188 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:22.501671 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:22.502107 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:22.502799 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:22.503261 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:22.503751 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:22.733839 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:22.746117 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:22.747821 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:22.749002 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1aa7211b-7bab-4f21-8f69-f945fb0e63bc tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.259592 Sep 13 06:49:22.749559 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 508/1029] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:22 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:23.350977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-541c8226-83f0-4f6d-9648-a46cf207a3a3 req-b6249337-271b-467f-b33e-855370aecc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a787fe-2c12-4673-a5c5-deaf07aecbe5", "name": "network-vif-deleted", "tag": "a22eab72-2623-4115-959c-236434d708e2"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:49:23.362476 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-541c8226-83f0-4f6d-9648-a46cf207a3a3 req-b6249337-271b-467f-b33e-855370aecc17 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:23.363222 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-541c8226-83f0-4f6d-9648-a46cf207a3a3 req-b6249337-271b-467f-b33e-855370aecc17 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:23.364260 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-541c8226-83f0-4f6d-9648-a46cf207a3a3 req-b6249337-271b-467f-b33e-855370aecc17 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:23.382341 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-541c8226-83f0-4f6d-9648-a46cf207a3a3 req-b6249337-271b-467f-b33e-855370aecc17 service nova] Creating event network-vif-deleted:a22eab72-2623-4115-959c-236434d708e2 for instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 on hv-cinder-85638 Sep 13 06:49:23.390478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-541c8226-83f0-4f6d-9648-a46cf207a3a3 req-b6249337-271b-467f-b33e-855370aecc17 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251661 Sep 13 06:49:23.392246 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 522/1030] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:49:23.466548 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:23.468048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:23.476579 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:23.479155 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:23.480659 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:23.483253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:23.483955 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:23.484736 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:23.529815 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:23.530916 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:23.531542 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:23.532155 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lazy-loading 'fault' on Instance uuid 60a787fe-2c12-4673-a5c5-deaf07aecbe5 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:49:23.591068 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac2d22d853a4984b229911bde3a450b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b763ebe3e21d4fc5a43f1af21362d401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:23.599688 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b5241e48-5467-4bb0-a973-44bde9e4bfa2 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 200 len: 1332 microversion: 2.1 time: 0.137570 Sep 13 06:49:23.603442 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 509/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:23 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 1332 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:23.776050 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:23.777027 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:23.783588 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:23.784156 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:23.784658 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:23.785423 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:23.785975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:23.786716 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:23.948353 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:23.958851 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:23.960376 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:23.962086 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ad33f043-8dfa-4ebe-b4c1-831a01ca85b9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.191551 Sep 13 06:49:23.963143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 523/1032] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:23 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:24.622120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:24.622797 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:24.629912 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:24.630403 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:24.630833 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:24.631553 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:24.632148 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:24.632697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:24.646920 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 HTTP/1.1 Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:49:24.649302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:24.650870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '60a787fe-2c12-4673-a5c5-deaf07aecbe5'} Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:24.651783 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:24.653232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:24.656368 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:24.656368 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-09f5632d-7665-4859-810b-178198cc0a8c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 404 len: 111 microversion: 2.1 time: 0.032487 Sep 13 06:49:24.656368 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 510/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:24 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:24.660332 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3c6dc588-f7df-4d18-a899-ebf6633ded08 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '.version_select at 0x7fdc0d5501f0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:24.665354 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c6dc588-f7df-4d18-a899-ebf6633ded08 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [8196626b-053c-45fd-9ce7-c9596f1e230f] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 06:49:24.990804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:24.991643 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:24.998109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:24.998717 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:24.999322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:25.000152 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:25.000723 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:25.001248 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:25.136753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:25.145427 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:25.146870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:25.148065 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-23fc1215-79a2-4567-8f51-a143668a5a32 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.161134 Sep 13 06:49:25.158656 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 511/1034] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:24 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:49:25.673996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c6dc588-f7df-4d18-a899-ebf6633ded08 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [8196626b-053c-45fd-9ce7-c9596f1e230f] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 36246. Sep 13 06:49:25.694269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3c6dc588-f7df-4d18-a899-ebf6633ded08 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032448362" status: 202 len: 0 microversion: 2.1 time: 1.037792 Sep 13 06:49:25.694996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 524/1035] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Sep 13 06:49:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032448362 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:49:26.174660 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:26.175243 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:26.181560 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:26.182037 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:26.182468 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:26.183150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:26.184062 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:26.184437 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:26.385511 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:26.394097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:26.395632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:26.396967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0e7d5967-0674-45be-a0af-8d16c37c874a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.226194 Sep 13 06:49:26.397530 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 512/1036] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:26 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:27.424711 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:27.425330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:27.433077 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:27.433563 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:27.434005 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:27.434701 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:27.435156 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:27.435625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:27.518037 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:27.518591 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:27.525485 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:27.526159 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:27.526584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:27.527277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:27.527767 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:27.528188 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: DELETE /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 HTTP/1.1 Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:49:27.551584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:27.553026 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '60a787fe-2c12-4673-a5c5-deaf07aecbe5'} Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:27.553804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:27.560253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:27.561795 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:27.561795 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e43af7a2-db7d-4036-9029-f7ec86a9b782 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 404 len: 111 microversion: 2.1 time: 0.031542 Sep 13 06:49:27.561795 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 513/1037] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:49:27 2022] DELETE /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 06:49:27.561795 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:27.561795 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 60a787fe-2c12-4673-a5c5-deaf07aecbe5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:27.562246 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:27.562246 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:27.562246 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:27.563025 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:27.563520 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:27.563946 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:27.577599 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 HTTP/1.1 Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:49:27.579451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:27.580838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '60a787fe-2c12-4673-a5c5-deaf07aecbe5'} Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:27.581607 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. Sep 13 06:49:27.582860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:27.585632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:27.585881 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance 60a787fe-2c12-4673-a5c5-deaf07aecbe5 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:27.586549 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-517275e9-d640-4983-ac61-bdb41bc664e0 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5" status: 404 len: 111 microversion: 2.1 time: 0.036106 Sep 13 06:49:27.590970 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 514/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:27 2022] GET /compute/v2.1/servers/60a787fe-2c12-4673-a5c5-deaf07aecbe5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:27.599554 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:27.600264 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:27.601444 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-24b4ed53-65f2-42ab-8b92-32aa167eac4c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.181468 Sep 13 06:49:27.602722 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 525/1039] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:27 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:28.627013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:28.627663 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:28.634082 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:28.634572 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:28.635010 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:28.635750 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:28.636219 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:28.636650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:28.730099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:28.730616 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:28.737269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:28.737891 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:28.738339 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:28.739046 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:28.739567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:28.739999 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:28.753829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: DELETE /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a HTTP/1.1 Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:49:28.755502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:49:28.756858 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '4531b7bb-f851-4652-8ae1-c60a44937f2a'} Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:28.757800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:49:28.760753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.764126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:28.764126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8e676c18-d9ef-4ad1-abe1-72f8490c2b37 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 404 len: 111 microversion: 2.1 time: 0.031336 Sep 13 06:49:28.764126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 526/1040] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:49:28 2022] DELETE /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 06:49:28.765674 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:28.766582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 4531b7bb-f851-4652-8ae1-c60a44937f2a] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:28.773411 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:28.774457 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:28.774922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:28.776559 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:28.777098 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:28.777997 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:28.790336 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:28.796936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a HTTP/1.1 Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:49:28.798482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:49:28.799889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '4531b7bb-f851-4652-8ae1-c60a44937f2a'} Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:28.800697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. Sep 13 06:49:28.801963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.804096 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance 4531b7bb-f851-4652-8ae1-c60a44937f2a could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:28.804254 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:28.804430 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-37daa500-cc27-4491-b1f3-f70ebd8e821c tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a" status: 404 len: 111 microversion: 2.1 time: 0.038062 Sep 13 06:49:28.804603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:28.804603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-435be182-1ed6-4af8-bfce-7f3c3705cc80 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.179121 Sep 13 06:49:28.804603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 515/1041] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:28 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:28.805101 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 527/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:28 2022] GET /compute/v2.1/servers/4531b7bb-f851-4652-8ae1-c60a44937f2a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:28.808409 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:28.808903 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:28.815278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:28.815806 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:28.816245 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:28.816942 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:28.817444 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:28.817816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:28.831524 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: DELETE /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 HTTP/1.1 Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:49:28.833101 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:49:28.834584 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'd9177caf-8489-4764-a082-2ac3fd7c23c6'} Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:28.835894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:49:28.839165 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.841097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:28.841097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-de4cc6ad-3005-4280-87c3-c0bacf72eff5 tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 404 len: 111 microversion: 2.1 time: 0.029637 Sep 13 06:49:28.841097 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 516/1043] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:49:28 2022] DELETE /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:28.843573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:28.844331 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: d9177caf-8489-4764-a082-2ac3fd7c23c6] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:28.850202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:28.850688 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:28.851130 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:28.852429 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:28.852890 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:28.853317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:28.866507 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 HTTP/1.1 Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:49:28.868109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:49:28.869471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': 'd9177caf-8489-4764-a082-2ac3fd7c23c6'} Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:28.870220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. Sep 13 06:49:28.871466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:28.872615 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance d9177caf-8489-4764-a082-2ac3fd7c23c6 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:28.872615 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b989b96c-9a50-4bb6-b8e5-ddcccefb313a tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6" status: 404 len: 111 microversion: 2.1 time: 0.029854 Sep 13 06:49:28.872615 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 528/1044] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:28 2022] GET /compute/v2.1/servers/d9177caf-8489-4764-a082-2ac3fd7c23c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:29.828301 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:29.828906 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:29.835604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:29.836088 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:29.836516 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:29.837203 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:29.837663 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:29.838081 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:29.971834 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:29.980801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:29.982239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:29.983410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1dba50cb-e456-4227-8c25-0612a9979d21 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.159061 Sep 13 06:49:29.983958 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 517/1045] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:29 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:30.136737 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:30.137326 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:30.139773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:30.145690 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:30.146145 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:30.146608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:30.147331 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:30.147821 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:30.148249 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:30.164089 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: DELETE /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba HTTP/1.1 Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:49:30.166816 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:49:30.168541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '1af9e76b-6689-431b-a4c2-2d681d4098ba'} Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:30.169347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:49:30.170666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:30.172037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:30.172037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-35f719c0-8734-441e-b8be-e4462091e04f tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 404 len: 111 microversion: 2.1 time: 0.035542 Sep 13 06:49:30.172037 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 529/1046] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:49:30 2022] DELETE /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:30.179575 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:30.179575 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] [instance: 1af9e76b-6689-431b-a4c2-2d681d4098ba] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:30.183921 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:30.184411 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:30.184841 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:30.185534 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:30.185985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:30.186407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:30.199711 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] HTTP exception thrown: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Request method failure captured: Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba HTTP/1.1 Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICUyfKprhI7Hcy6m7t8JEvx_D2vjmFCsG6VkLutW5-kVe03jt-ozqMKo3vFne0EWja52j6Hv8zUzZaN_3sNVnstQs-lty5suw0BzdHWDtbar55mUImhbF2b9YEe_8TyYWCl2IPNemgjgMeUTYWdB5sPSf8Kxmiy48wcC-IsccYxB7dc Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:49:30.201310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b763ebe3e21d4fc5a43f1af21362d401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: b763ebe3e21d4fc5a43f1af21362d401 Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-566040300 Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: cac2d22d853a4984b229911bde3a450b Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeNegativeTest-566040300-project Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:49:30.203040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '1af9e76b-6689-431b-a4c2-2d681d4098ba'} Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:30.204005 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. Sep 13 06:49:30.209147 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:30.210395 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] Returning 404 to user: Instance 1af9e76b-6689-431b-a4c2-2d681d4098ba could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:30.210395 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-665b4910-20f8-4b21-a46b-5a7baae9400e tempest-AttachVolumeNegativeTest-566040300 tempest-AttachVolumeNegativeTest-566040300-project] 10.222.0.17 "GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba" status: 404 len: 111 microversion: 2.1 time: 0.030650 Sep 13 06:49:30.210395 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 518/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:30 2022] GET /compute/v2.1/servers/1af9e76b-6689-431b-a4c2-2d681d4098ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:31.010005 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:31.010631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:31.016624 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:31.017104 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:31.017539 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:31.018232 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:31.018684 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:31.019137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:31.150126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:31.158750 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:31.160303 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:31.161465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3cd81040-ca7c-42e3-b8ca-6599bfd2cff2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.156037 Sep 13 06:49:31.162217 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 530/1048] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:31 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:32.187310 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:32.189411 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:32.196235 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=60 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:32.198205 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:32.198937 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:32.199755 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:32.200679 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:32.201339 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:32.201974 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:32.442376 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:32.452160 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:32.454128 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:32.455313 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-77b5b88a-90bc-4b18-9439-c0320f96a7e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.272053 Sep 13 06:49:32.467543 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 519/1049] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:32 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:33.485538 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:33.486562 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:33.533459 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:33.538038 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:33.538666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:33.540859 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:33.545587 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:33.548923 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:33.683705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-c5f428ad-71be-452b-b635-15442258c91f req-d032e698-7548-47a1-b1f8-410138287bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd984c2d-db41-44f6-9324-394602908a4b", "name": "network-vif-plugged", "status": "completed", "tag": "85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:49:33.697015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-c5f428ad-71be-452b-b635-15442258c91f req-d032e698-7548-47a1-b1f8-410138287bc4 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:33.701608 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-c5f428ad-71be-452b-b635-15442258c91f req-d032e698-7548-47a1-b1f8-410138287bc4 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:33.702096 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-c5f428ad-71be-452b-b635-15442258c91f req-d032e698-7548-47a1-b1f8-410138287bc4 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:33.706590 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=100 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:33.734108 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-c5f428ad-71be-452b-b635-15442258c91f req-d032e698-7548-47a1-b1f8-410138287bc4 service nova] Creating event network-vif-plugged:85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b for instance fd984c2d-db41-44f6-9324-394602908a4b on hv-cinder-85638 Sep 13 06:49:33.740486 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-c5f428ad-71be-452b-b635-15442258c91f req-d032e698-7548-47a1-b1f8-410138287bc4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060854 Sep 13 06:49:33.741517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 520/1050] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:49:33.788066 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:33.801105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:33.803227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:33.804909 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c0f4f927-fcdc-4b6c-a1a3-4ccf6988de8b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.326522 Sep 13 06:49:33.806595 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 531/1051] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:33 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:49:34.834073 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:34.834771 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:34.841989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:34.842724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:34.843330 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:34.844436 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:34.845055 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:34.845888 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:35.006207 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:35.016673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:35.018838 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:35.020086 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-06de50f3-b933-4aba-acc0-c061a5eab81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.190900 Sep 13 06:49:35.020851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 521/1052] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:34 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:36.046295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:36.046902 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:36.053275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:36.053756 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:36.054191 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:36.055510 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:36.055966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:36.056391 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:36.187826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:36.201935 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:36.204207 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:36.205383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b1c0277e-aab1-41fb-abdd-42636e1c1cb6 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1809 microversion: 2.20 time: 0.163064 Sep 13 06:49:36.205933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 532/1053] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:36 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:36.832485 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-daf21fcb-e158-48c6-881c-9b47eebf42fb tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d5b71f0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:36.879555 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-daf21fcb-e158-48c6-881c-9b47eebf42fb tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/45bc83dd-c54e-4633-bcf1-569513008401" status: 200 len: 349 microversion: 2.1 time: 0.050845 Sep 13 06:49:36.880908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 522/1054] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:49:36 2022] GET /compute/v2.1/os-volumes/45bc83dd-c54e-4633-bcf1-569513008401 => generated 349 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:49:37.233410 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:37.234013 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:37.236107 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 06:49:37.236242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Tue Sep 13 06:49:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b (ip 10.222.0.17) !!! Sep 13 06:49:37.243529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:37.244136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:37.244636 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:37.245322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:37.245773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:37.246190 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:37.373987 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:37.382537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:37.384999 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:37.386275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d162fadd-983e-4c36-bf23-6e40dccf9ee9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1796 microversion: 2.20 time: 0.156792 Sep 13 06:49:37.386827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 533/1055] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:49:37 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:49:38.748947 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c468a39e-2cc3-458b-9b2a-b67f4f819160 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:38.749696 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c468a39e-2cc3-458b-9b2a-b67f4f819160 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:38.751663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-375dad07-4d03-4cce-aee8-e2ff02aa443b req-3dccf2d5-c4dc-4b6b-b449-66ea86002a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757cfd27-33d5-4139-adef-9d92d44795a7", "tag": "652aa8a2-ec94-42b2-8fc4-270bfe350fd4"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:49:38.757651 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c468a39e-2cc3-458b-9b2a-b67f4f819160 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:38.758407 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c468a39e-2cc3-458b-9b2a-b67f4f819160 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:38.758915 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c468a39e-2cc3-458b-9b2a-b67f4f819160 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:38.759848 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c468a39e-2cc3-458b-9b2a-b67f4f819160 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:38.760510 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c468a39e-2cc3-458b-9b2a-b67f4f819160 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:38.761105 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c468a39e-2cc3-458b-9b2a-b67f4f819160 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:38.761394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-375dad07-4d03-4cce-aee8-e2ff02aa443b req-3dccf2d5-c4dc-4b6b-b449-66ea86002a87 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:38.761869 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-375dad07-4d03-4cce-aee8-e2ff02aa443b req-3dccf2d5-c4dc-4b6b-b449-66ea86002a87 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:38.762296 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-375dad07-4d03-4cce-aee8-e2ff02aa443b req-3dccf2d5-c4dc-4b6b-b449-66ea86002a87 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:38.765968 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:38.774718 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-375dad07-4d03-4cce-aee8-e2ff02aa443b req-3dccf2d5-c4dc-4b6b-b449-66ea86002a87 service nova] Creating event network-changed:652aa8a2-ec94-42b2-8fc4-270bfe350fd4 for instance 757cfd27-33d5-4139-adef-9d92d44795a7 on hv-cinder-85638 Sep 13 06:49:38.780975 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-375dad07-4d03-4cce-aee8-e2ff02aa443b req-3dccf2d5-c4dc-4b6b-b449-66ea86002a87 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032831 Sep 13 06:49:38.784417 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 534/1056] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:49:38.791819 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c468a39e-2cc3-458b-9b2a-b67f4f819160 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Going to try to terminate instance {{(pid=132398) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:49:38.866539 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c468a39e-2cc3-458b-9b2a-b67f4f819160 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "DELETE /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 204 len: 0 microversion: 2.1 time: 0.121553 Sep 13 06:49:38.867189 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 523/1057] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:49:38 2022] DELETE /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:49:38.880409 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-abfb7d2a-f342-4f6a-9467-0725e85cdf8c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:38.881102 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-abfb7d2a-f342-4f6a-9467-0725e85cdf8c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:38.887734 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-abfb7d2a-f342-4f6a-9467-0725e85cdf8c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:38.889105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-abfb7d2a-f342-4f6a-9467-0725e85cdf8c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:38.889552 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-abfb7d2a-f342-4f6a-9467-0725e85cdf8c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:38.890241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-abfb7d2a-f342-4f6a-9467-0725e85cdf8c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:38.890690 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-abfb7d2a-f342-4f6a-9467-0725e85cdf8c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:38.891110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-abfb7d2a-f342-4f6a-9467-0725e85cdf8c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:39.023884 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-abfb7d2a-f342-4f6a-9467-0725e85cdf8c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:39.031625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-abfb7d2a-f342-4f6a-9467-0725e85cdf8c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1575 microversion: 2.1 time: 0.155352 Sep 13 06:49:39.032290 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 535/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:38 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:40.056322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2ede107d-ff89-4dd5-a47e-27280eac8980 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:40.056937 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2ede107d-ff89-4dd5-a47e-27280eac8980 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:40.063276 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ede107d-ff89-4dd5-a47e-27280eac8980 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:40.063786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ede107d-ff89-4dd5-a47e-27280eac8980 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:40.064219 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ede107d-ff89-4dd5-a47e-27280eac8980 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:40.064904 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ede107d-ff89-4dd5-a47e-27280eac8980 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:40.065364 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ede107d-ff89-4dd5-a47e-27280eac8980 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:40.065786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2ede107d-ff89-4dd5-a47e-27280eac8980 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:40.198126 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2ede107d-ff89-4dd5-a47e-27280eac8980 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:40.205967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2ede107d-ff89-4dd5-a47e-27280eac8980 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1575 microversion: 2.1 time: 0.154432 Sep 13 06:49:40.206536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 524/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:40 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:41.228891 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bd283d4d-2fca-446f-9608-6fb5e2353916 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:41.229498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-bd283d4d-2fca-446f-9608-6fb5e2353916 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:41.236002 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bd283d4d-2fca-446f-9608-6fb5e2353916 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:41.236472 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bd283d4d-2fca-446f-9608-6fb5e2353916 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:41.236903 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bd283d4d-2fca-446f-9608-6fb5e2353916 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:41.237585 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bd283d4d-2fca-446f-9608-6fb5e2353916 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:41.238039 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bd283d4d-2fca-446f-9608-6fb5e2353916 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:41.238456 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bd283d4d-2fca-446f-9608-6fb5e2353916 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:41.370388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-bd283d4d-2fca-446f-9608-6fb5e2353916 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:41.378234 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-bd283d4d-2fca-446f-9608-6fb5e2353916 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1575 microversion: 2.1 time: 0.153164 Sep 13 06:49:41.378799 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 536/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:41 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:42.401567 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-197d8055-9324-4a28-b275-36ca9ded205f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:42.402193 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-197d8055-9324-4a28-b275-36ca9ded205f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:42.409500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-197d8055-9324-4a28-b275-36ca9ded205f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:42.409992 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-197d8055-9324-4a28-b275-36ca9ded205f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:42.410603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-197d8055-9324-4a28-b275-36ca9ded205f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:42.411507 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-197d8055-9324-4a28-b275-36ca9ded205f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:42.412134 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-197d8055-9324-4a28-b275-36ca9ded205f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:42.412563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-197d8055-9324-4a28-b275-36ca9ded205f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:42.438663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e75a8c6d-7935-45e5-bab2-fbb729a4048b tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d5aa5e0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:42.494239 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e75a8c6d-7935-45e5-bab2-fbb729a4048b tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/f7f6c32f-cb2a-4ee8-9d1c-03f3980278e3" status: 200 len: 351 microversion: 2.1 time: 0.060906 Sep 13 06:49:42.494900 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 537/1061] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:49:42 2022] GET /compute/v2.1/os-volumes/f7f6c32f-cb2a-4ee8-9d1c-03f3980278e3 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:49:42.596876 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-197d8055-9324-4a28-b275-36ca9ded205f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:42.605208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-197d8055-9324-4a28-b275-36ca9ded205f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1575 microversion: 2.1 time: 0.207436 Sep 13 06:49:42.605764 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 525/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:42 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1575 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:43.555596 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-0363155e-b7b1-44f8-bb53-752f04599bd5 req-39fa029b-a0a7-475b-8a51-b49c480d6b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757cfd27-33d5-4139-adef-9d92d44795a7", "name": "network-vif-deleted", "tag": "652aa8a2-ec94-42b2-8fc4-270bfe350fd4"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:49:43.565866 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0363155e-b7b1-44f8-bb53-752f04599bd5 req-39fa029b-a0a7-475b-8a51-b49c480d6b27 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:43.566342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0363155e-b7b1-44f8-bb53-752f04599bd5 req-39fa029b-a0a7-475b-8a51-b49c480d6b27 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:43.566770 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-0363155e-b7b1-44f8-bb53-752f04599bd5 req-39fa029b-a0a7-475b-8a51-b49c480d6b27 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:43.577631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-0363155e-b7b1-44f8-bb53-752f04599bd5 req-39fa029b-a0a7-475b-8a51-b49c480d6b27 service nova] Creating event network-vif-deleted:652aa8a2-ec94-42b2-8fc4-270bfe350fd4 for instance 757cfd27-33d5-4139-adef-9d92d44795a7 on hv-cinder-85638 Sep 13 06:49:43.584631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-0363155e-b7b1-44f8-bb53-752f04599bd5 req-39fa029b-a0a7-475b-8a51-b49c480d6b27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 Sep 13 06:49:43.585237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 538/1063] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:49:43.629323 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a0eac231-2c6f-4138-9d16-56c028a45c9e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:43.629936 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a0eac231-2c6f-4138-9d16-56c028a45c9e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:43.636928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0eac231-2c6f-4138-9d16-56c028a45c9e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:43.637415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0eac231-2c6f-4138-9d16-56c028a45c9e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:43.637849 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0eac231-2c6f-4138-9d16-56c028a45c9e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:43.638536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0eac231-2c6f-4138-9d16-56c028a45c9e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:43.638995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0eac231-2c6f-4138-9d16-56c028a45c9e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:43.639445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a0eac231-2c6f-4138-9d16-56c028a45c9e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:43.706106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a0eac231-2c6f-4138-9d16-56c028a45c9e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:43.714072 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a0eac231-2c6f-4138-9d16-56c028a45c9e tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 200 len: 1224 microversion: 2.1 time: 0.088595 Sep 13 06:49:43.714642 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 526/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:43 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:43.834071 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d1f4818b-921a-4ba1-bf46-be2a35ec6cb4 tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d5e71f0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:43.886436 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d1f4818b-921a-4ba1-bf46-be2a35ec6cb4 tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3d504f11-e98e-4d46-9867-a96bc62f9c58" status: 200 len: 351 microversion: 2.1 time: 0.056382 Sep 13 06:49:43.887086 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 539/1065] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Sep 13 06:49:43 2022] GET /compute/v2.1/os-volumes/3d504f11-e98e-4d46-9867-a96bc62f9c58 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:49:43.901297 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1d96329a-26d7-4e73-88ba-c86857f796cc tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d418a60>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:43.997171 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1d96329a-26d7-4e73-88ba-c86857f796cc tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099954 Sep 13 06:49:43.997752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 527/1066] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Sep 13 06:49:43 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:44.011817 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3b3be9c1-4658-4fe7-a30c-dc7f471f621c tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d51dc10>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:44.096295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3b3be9c1-4658-4fe7-a30c-dc7f471f621c tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088291 Sep 13 06:49:44.097506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 540/1067] 10.222.0.17 () {58 vars in 1149 bytes} [Tue Sep 13 06:49:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:49:44.113325 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-05d7aa12-1d5b-4dd8-8880-468a6a4e70db tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d3dbb80>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:44.401252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-05d7aa12-1d5b-4dd8-8880-468a6a4e70db tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.291740 Sep 13 06:49:44.401813 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 528/1068] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Sep 13 06:49:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:44.415949 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a9d4e54b-7591-4003-96ae-b6cb6a43f72c tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d5aa8b0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:44.498006 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a9d4e54b-7591-4003-96ae-b6cb6a43f72c tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086858 Sep 13 06:49:44.498571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 541/1069] 10.222.0.17 () {58 vars in 1167 bytes} [Tue Sep 13 06:49:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:49:44.512649 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0fbc012d-690a-42bb-b9d2-ec9890027cc2 tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d5cd550>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:44.607172 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0fbc012d-690a-42bb-b9d2-ec9890027cc2 tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.098568 Sep 13 06:49:44.607806 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 529/1070] 10.222.0.17 () {58 vars in 1170 bytes} [Tue Sep 13 06:49:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:49:44.628364 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d404ca85-208b-419a-9bb0-052b587af030 tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d5aa280>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:44.720821 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d404ca85-208b-419a-9bb0-052b587af030 tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.101842 Sep 13 06:49:44.721394 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 542/1071] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Sep 13 06:49:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:49:44.736137 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a92aeeb3-b903-4b24-9a09-d2fb7b259682 tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d418430>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:44.745383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:44.746115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 757cfd27-33d5-4139-adef-9d92d44795a7] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:44.753140 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:44.754558 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:44.755003 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:44.755803 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:44.756298 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:44.756732 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:44.772261 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] HTTP exception thrown: Instance 757cfd27-33d5-4139-adef-9d92d44795a7 could not be found. Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Request method failure captured: Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 HTTP/1.1 Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICWICMyK7_4dBjo20FNu48ZRRvnAVn71PlzkHxPiDTHfL8A5JA1lb0Dd0LBBVaHDwvxUpabUZ_82xTDVKm6hl2Jr9myYlbnlAMJlnt2iAaAFlMNbuXtE0Nl_I-BKHRPvbniERFogNcUUy-sRCWtK_rbLxZsjxRHzfKUaEI3qu_8kEZM Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 5d92a2cc741d45aba5ac112718389c22 Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:49:44.774691 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 5d92a2cc741d45aba5ac112718389c22 Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-TestVolumeBootPattern-1653757791-project Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: ca7cb5590aff4b0283cd583b391a5ffe Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-TestVolumeBootPattern-1653757791-project Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 757cfd27-33d5-4139-adef-9d92d44795a7 could not be found. Sep 13 06:49:44.776426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '757cfd27-33d5-4139-adef-9d92d44795a7'} Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757cfd27-33d5-4139-adef-9d92d44795a7 could not be found. Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:44.777506 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757cfd27-33d5-4139-adef-9d92d44795a7 could not be found. Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757cfd27-33d5-4139-adef-9d92d44795a7 could not be found. Sep 13 06:49:44.779129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:44.780526 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Returning 404 to user: Instance 757cfd27-33d5-4139-adef-9d92d44795a7 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:44.780526 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ea753394-f0de-4ebd-9290-6eed556629f1 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7" status: 404 len: 111 microversion: 2.1 time: 0.036342 Sep 13 06:49:44.780526 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 543/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:44 2022] GET /compute/v2.1/servers/757cfd27-33d5-4139-adef-9d92d44795a7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:44.831714 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a92aeeb3-b903-4b24-9a09-d2fb7b259682 tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099974 Sep 13 06:49:44.842770 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 530/1073] 10.222.0.17 () {58 vars in 1188 bytes} [Tue Sep 13 06:49:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:49:44.851063 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b43f98cd-a62e-4da5-b3f2-a3aff601d963 tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] Calling method '.version_select at 0x7fdc0d51de50>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:44.953644 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b43f98cd-a62e-4da5-b3f2-a3aff601d963 tempest-VolumesTestJSON-1307736582 tempest-VolumesTestJSON-1307736582-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.109957 Sep 13 06:49:44.954216 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 544/1074] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Sep 13 06:49:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:47.892967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-458718ce-fc8c-4da3-bf44-95f2eed46e16 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:47.893474 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-458718ce-fc8c-4da3-bf44-95f2eed46e16 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:47.895879 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-74b6355c-4104-4d41-ac43-61b64485ed3a req-2f9c7ccb-6e0e-4486-bb18-d8b264006fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b6c6b92-7678-4f2d-bf4c-908373527d92", "tag": "6d8cd90d-8dbe-4213-9fee-bf02025eca4d"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:49:47.899961 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-458718ce-fc8c-4da3-bf44-95f2eed46e16 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:47.900452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-458718ce-fc8c-4da3-bf44-95f2eed46e16 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:47.900893 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-458718ce-fc8c-4da3-bf44-95f2eed46e16 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:47.901825 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-458718ce-fc8c-4da3-bf44-95f2eed46e16 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:47.902499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-458718ce-fc8c-4da3-bf44-95f2eed46e16 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:47.902931 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-458718ce-fc8c-4da3-bf44-95f2eed46e16 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:47.906625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-74b6355c-4104-4d41-ac43-61b64485ed3a req-2f9c7ccb-6e0e-4486-bb18-d8b264006fe5 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:47.907198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-74b6355c-4104-4d41-ac43-61b64485ed3a req-2f9c7ccb-6e0e-4486-bb18-d8b264006fe5 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:47.907856 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-74b6355c-4104-4d41-ac43-61b64485ed3a req-2f9c7ccb-6e0e-4486-bb18-d8b264006fe5 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:47.919165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-74b6355c-4104-4d41-ac43-61b64485ed3a req-2f9c7ccb-6e0e-4486-bb18-d8b264006fe5 service nova] Creating event network-changed:6d8cd90d-8dbe-4213-9fee-bf02025eca4d for instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 on hv-cinder-85638 Sep 13 06:49:47.924748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-74b6355c-4104-4d41-ac43-61b64485ed3a req-2f9c7ccb-6e0e-4486-bb18-d8b264006fe5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033143 Sep 13 06:49:47.925690 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 545/1075] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:49:47.930268 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-458718ce-fc8c-4da3-bf44-95f2eed46e16 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Going to try to terminate instance {{(pid=132398) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:49:48.014884 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-458718ce-fc8c-4da3-bf44-95f2eed46e16 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 204 len: 0 microversion: 2.1 time: 0.124185 Sep 13 06:49:48.015541 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 531/1076] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:49:47 2022] DELETE /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:49:48.024470 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3c95081f-0914-401a-bbd9-a8149ddb931f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:48.025172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3c95081f-0914-401a-bbd9-a8149ddb931f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:48.031698 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c95081f-0914-401a-bbd9-a8149ddb931f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:48.032253 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c95081f-0914-401a-bbd9-a8149ddb931f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:48.032682 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c95081f-0914-401a-bbd9-a8149ddb931f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:48.033393 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c95081f-0914-401a-bbd9-a8149ddb931f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:48.033849 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c95081f-0914-401a-bbd9-a8149ddb931f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:48.034265 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c95081f-0914-401a-bbd9-a8149ddb931f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:48.170684 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3c95081f-0914-401a-bbd9-a8149ddb931f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:48.178431 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3c95081f-0914-401a-bbd9-a8149ddb931f tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1576 microversion: 2.1 time: 0.158555 Sep 13 06:49:48.178991 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 546/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:48 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:48.332430 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1e9cb594-0480-489f-8fe3-915bd0b7f071 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:49:48.333138 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1e9cb594-0480-489f-8fe3-915bd0b7f071 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:48.340192 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e9cb594-0480-489f-8fe3-915bd0b7f071 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:48.341452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e9cb594-0480-489f-8fe3-915bd0b7f071 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:48.342179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e9cb594-0480-489f-8fe3-915bd0b7f071 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:48.343115 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e9cb594-0480-489f-8fe3-915bd0b7f071 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:48.344030 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e9cb594-0480-489f-8fe3-915bd0b7f071 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:48.344682 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1e9cb594-0480-489f-8fe3-915bd0b7f071 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:48.378909 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-1e9cb594-0480-489f-8fe3-915bd0b7f071 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lazy-loading 'flavor' on Instance uuid dfd6a470-5bbf-4d29-b5e2-860f8f7c551b {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:49:48.472618 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1e9cb594-0480-489f-8fe3-915bd0b7f071 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "POST /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b/action" status: 202 len: 0 microversion: 2.1 time: 0.144316 Sep 13 06:49:48.473275 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 532/1078] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:49:48 2022] POST /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:49:48.482407 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-027ea06d-0579-4b50-a99e-8267c3806dfb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:48.486181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-027ea06d-0579-4b50-a99e-8267c3806dfb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:48.494586 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-027ea06d-0579-4b50-a99e-8267c3806dfb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:48.495072 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-027ea06d-0579-4b50-a99e-8267c3806dfb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:48.496295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-027ea06d-0579-4b50-a99e-8267c3806dfb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:48.496994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-027ea06d-0579-4b50-a99e-8267c3806dfb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:48.497448 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-027ea06d-0579-4b50-a99e-8267c3806dfb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:48.497868 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-027ea06d-0579-4b50-a99e-8267c3806dfb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:48.772126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-027ea06d-0579-4b50-a99e-8267c3806dfb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:48.780703 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-027ea06d-0579-4b50-a99e-8267c3806dfb tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.302773 Sep 13 06:49:48.781885 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 547/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:48 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:49.204609 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b15a8d92-96e5-45ef-9e6e-8875f6a833a3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:49.205557 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b15a8d92-96e5-45ef-9e6e-8875f6a833a3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:49.214446 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b15a8d92-96e5-45ef-9e6e-8875f6a833a3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:49.215048 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b15a8d92-96e5-45ef-9e6e-8875f6a833a3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:49.215606 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b15a8d92-96e5-45ef-9e6e-8875f6a833a3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:49.216580 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b15a8d92-96e5-45ef-9e6e-8875f6a833a3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:49.217360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b15a8d92-96e5-45ef-9e6e-8875f6a833a3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:49.217971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b15a8d92-96e5-45ef-9e6e-8875f6a833a3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:49.381029 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b15a8d92-96e5-45ef-9e6e-8875f6a833a3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:49.407581 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b15a8d92-96e5-45ef-9e6e-8875f6a833a3 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1457 microversion: 2.1 time: 0.208627 Sep 13 06:49:49.409550 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 533/1080] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:49 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1457 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:49.805128 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-03137edb-a8e2-411b-b6c8-5ae60e6ce47d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:49.805981 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-03137edb-a8e2-411b-b6c8-5ae60e6ce47d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:49.812426 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03137edb-a8e2-411b-b6c8-5ae60e6ce47d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:49.813181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03137edb-a8e2-411b-b6c8-5ae60e6ce47d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:49.813626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03137edb-a8e2-411b-b6c8-5ae60e6ce47d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:49.814441 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03137edb-a8e2-411b-b6c8-5ae60e6ce47d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:49.814902 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03137edb-a8e2-411b-b6c8-5ae60e6ce47d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:49.815327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-03137edb-a8e2-411b-b6c8-5ae60e6ce47d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:49.939197 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-463d5db5-4fb6-4f28-8c22-bb1e8766fb81 req-7d2d5d70-4c6f-4a38-81f9-350cb2ced0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b6c6b92-7678-4f2d-bf4c-908373527d92", "name": "network-vif-deleted", "tag": "6d8cd90d-8dbe-4213-9fee-bf02025eca4d"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:49:49.949303 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-463d5db5-4fb6-4f28-8c22-bb1e8766fb81 req-7d2d5d70-4c6f-4a38-81f9-350cb2ced0fb service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:49.950636 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-463d5db5-4fb6-4f28-8c22-bb1e8766fb81 req-7d2d5d70-4c6f-4a38-81f9-350cb2ced0fb service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:49.951289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-463d5db5-4fb6-4f28-8c22-bb1e8766fb81 req-7d2d5d70-4c6f-4a38-81f9-350cb2ced0fb service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:49.971104 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-463d5db5-4fb6-4f28-8c22-bb1e8766fb81 req-7d2d5d70-4c6f-4a38-81f9-350cb2ced0fb service nova] Creating event network-vif-deleted:6d8cd90d-8dbe-4213-9fee-bf02025eca4d for instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 on hv-cinder-85638 Sep 13 06:49:49.976765 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-463d5db5-4fb6-4f28-8c22-bb1e8766fb81 req-7d2d5d70-4c6f-4a38-81f9-350cb2ced0fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040609 Sep 13 06:49:49.977596 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 534/1081] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:49:50.011406 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-03137edb-a8e2-411b-b6c8-5ae60e6ce47d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:50.019213 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-03137edb-a8e2-411b-b6c8-5ae60e6ce47d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.219124 Sep 13 06:49:50.019813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 548/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:49 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:50.432301 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:50.433248 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:50.440422 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:50.440906 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:50.441339 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:50.442053 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:50.442505 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:50.443006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:50.474752 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:50.475232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:50.475766 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:50.476252 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lazy-loading 'fault' on Instance uuid 7b6c6b92-7678-4f2d-bf4c-908373527d92 {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:49:50.523662 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7cb5590aff4b0283cd583b391a5ffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d92a2cc741d45aba5ac112718389c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:50.531773 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ee44a834-c71b-47d9-951f-aa16c9da9f06 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 200 len: 1230 microversion: 2.1 time: 0.104109 Sep 13 06:49:50.532344 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 535/1083] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:50 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:51.043500 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-141ea24c-aafc-4b8d-96dd-09491aefa5c1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:51.044116 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-141ea24c-aafc-4b8d-96dd-09491aefa5c1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:51.052162 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-141ea24c-aafc-4b8d-96dd-09491aefa5c1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:51.052651 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-141ea24c-aafc-4b8d-96dd-09491aefa5c1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:51.053284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-141ea24c-aafc-4b8d-96dd-09491aefa5c1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:51.054401 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-141ea24c-aafc-4b8d-96dd-09491aefa5c1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:51.055753 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-141ea24c-aafc-4b8d-96dd-09491aefa5c1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:51.056184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-141ea24c-aafc-4b8d-96dd-09491aefa5c1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:51.220271 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-141ea24c-aafc-4b8d-96dd-09491aefa5c1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:51.228641 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-141ea24c-aafc-4b8d-96dd-09491aefa5c1 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.189866 Sep 13 06:49:51.229226 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 549/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:51 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:51.554142 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:51.555673 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 7b6c6b92-7678-4f2d-bf4c-908373527d92] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:51.561721 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:51.562244 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:51.562684 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:51.563398 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:51.563862 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:51.564308 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:51.578799 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] HTTP exception thrown: Instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 could not be found. Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Request method failure captured: Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 HTTP/1.1 Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICWICMyK7_4dBjo20FNu48ZRRvnAVn71PlzkHxPiDTHfL8A5JA1lb0Dd0LBBVaHDwvxUpabUZ_82xTDVKm6hl2Jr9myYlbnlAMJlnt2iAaAFlMNbuXtE0Nl_I-BKHRPvbniERFogNcUUy-sRCWtK_rbLxZsjxRHzfKUaEI3qu_8kEZM Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 5d92a2cc741d45aba5ac112718389c22 Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:49:51.580506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 5d92a2cc741d45aba5ac112718389c22 Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-TestVolumeBootPattern-1653757791-project Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: ca7cb5590aff4b0283cd583b391a5ffe Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-TestVolumeBootPattern-1653757791-project Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 could not be found. Sep 13 06:49:51.582158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '7b6c6b92-7678-4f2d-bf4c-908373527d92'} Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 could not be found. Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:51.583036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 could not be found. Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 could not be found. Sep 13 06:49:51.584417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:51.585650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Returning 404 to user: Instance 7b6c6b92-7678-4f2d-bf4c-908373527d92 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:51.585650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-674e222f-78c4-4ea4-baaf-8ed222ec70f4 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92" status: 404 len: 111 microversion: 2.1 time: 0.031644 Sep 13 06:49:51.585650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 536/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:51 2022] GET /compute/v2.1/servers/7b6c6b92-7678-4f2d-bf4c-908373527d92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:52.167279 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:52.167936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:52.174829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:52.174936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:52.175338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:52.176059 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:52.176512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:52.176931 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:52.190498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] HTTP exception thrown: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Request method failure captured: Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: DELETE /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 HTTP/1.1 Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICWICMyK7_4dBjo20FNu48ZRRvnAVn71PlzkHxPiDTHfL8A5JA1lb0Dd0LBBVaHDwvxUpabUZ_82xTDVKm6hl2Jr9myYlbnlAMJlnt2iAaAFlMNbuXtE0Nl_I-BKHRPvbniERFogNcUUy-sRCWtK_rbLxZsjxRHzfKUaEI3qu_8kEZM Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 5d92a2cc741d45aba5ac112718389c22 Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:49:52.192189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 5d92a2cc741d45aba5ac112718389c22 Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-TestVolumeBootPattern-1653757791-project Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: ca7cb5590aff4b0283cd583b391a5ffe Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-TestVolumeBootPattern-1653757791-project Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:49:52.193966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '462ba976-b35b-433e-b247-03eaef8428a5'} Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:52.196105 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:49:52.197373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:49:52.198881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Returning 404 to user: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:52.198881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-53c1ab1f-c6a8-43c9-9ea5-42d6913bc751 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "DELETE /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 404 len: 111 microversion: 2.1 time: 0.031213 Sep 13 06:49:52.198881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 550/1086] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:49:52 2022] DELETE /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:52.202346 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:52.202958 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] [instance: 462ba976-b35b-433e-b247-03eaef8428a5] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:52.208776 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:52.209255 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:52.209684 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:52.210368 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:52.211307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:52.211754 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:52.225150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] HTTP exception thrown: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Request method failure captured: Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 HTTP/1.1 Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICWICMyK7_4dBjo20FNu48ZRRvnAVn71PlzkHxPiDTHfL8A5JA1lb0Dd0LBBVaHDwvxUpabUZ_82xTDVKm6hl2Jr9myYlbnlAMJlnt2iAaAFlMNbuXtE0Nl_I-BKHRPvbniERFogNcUUy-sRCWtK_rbLxZsjxRHzfKUaEI3qu_8kEZM Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 5d92a2cc741d45aba5ac112718389c22 Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:49:52.227278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5d92a2cc741d45aba5ac112718389c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 5d92a2cc741d45aba5ac112718389c22 Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-TestVolumeBootPattern-1653757791 Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-TestVolumeBootPattern-1653757791-project Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: ca7cb5590aff4b0283cd583b391a5ffe Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-TestVolumeBootPattern-1653757791-project Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:49:52.228944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '462ba976-b35b-433e-b247-03eaef8428a5'} Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:49:52.230034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. Sep 13 06:49:52.231289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:49:52.232606 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Returning 404 to user: Instance 462ba976-b35b-433e-b247-03eaef8428a5 could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:49:52.232606 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8c43b700-0902-4ce0-9c2e-5a53ab753950 tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5" status: 404 len: 111 microversion: 2.1 time: 0.030226 Sep 13 06:49:52.232606 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 537/1087] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:52 2022] GET /compute/v2.1/servers/462ba976-b35b-433e-b247-03eaef8428a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:49:52.252248 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-cd7e382e-f9d1-412c-95d6-c97ad9d620c7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:52.252883 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-cd7e382e-f9d1-412c-95d6-c97ad9d620c7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:52.259638 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cd7e382e-f9d1-412c-95d6-c97ad9d620c7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:52.260203 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cd7e382e-f9d1-412c-95d6-c97ad9d620c7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:52.260906 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cd7e382e-f9d1-412c-95d6-c97ad9d620c7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:52.261718 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cd7e382e-f9d1-412c-95d6-c97ad9d620c7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:52.262172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cd7e382e-f9d1-412c-95d6-c97ad9d620c7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:52.262767 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-cd7e382e-f9d1-412c-95d6-c97ad9d620c7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:52.412623 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-cd7e382e-f9d1-412c-95d6-c97ad9d620c7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:52.420932 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-cd7e382e-f9d1-412c-95d6-c97ad9d620c7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.173147 Sep 13 06:49:52.421495 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 551/1088] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:52 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:53.444631 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a9fce500-7c10-4365-a745-6c1ef0ea4265 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:53.446475 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a9fce500-7c10-4365-a745-6c1ef0ea4265 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:53.454537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a9fce500-7c10-4365-a745-6c1ef0ea4265 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:53.455208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a9fce500-7c10-4365-a745-6c1ef0ea4265 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:53.456020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a9fce500-7c10-4365-a745-6c1ef0ea4265 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:53.457178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a9fce500-7c10-4365-a745-6c1ef0ea4265 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:53.457937 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a9fce500-7c10-4365-a745-6c1ef0ea4265 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:53.458528 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a9fce500-7c10-4365-a745-6c1ef0ea4265 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:53.574043 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a984e91b-4b75-4638-8bc9-dfe3b1d9413c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] Calling method '.version_select at 0x7fdc0d51d1f0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:53.616493 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a984e91b-4b75-4638-8bc9-dfe3b1d9413c tempest-TestVolumeBootPattern-1653757791 tempest-TestVolumeBootPattern-1653757791-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-621610664" status: 202 len: 0 microversion: 2.1 time: 0.049833 Sep 13 06:49:53.617709 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 552/1089] 10.222.0.17 () {58 vars in 1260 bytes} [Tue Sep 13 06:49:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-621610664 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:49:53.925264 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a9fce500-7c10-4365-a745-6c1ef0ea4265 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:53.928029 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:53.936631 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a9fce500-7c10-4365-a745-6c1ef0ea4265 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.496157 Sep 13 06:49:53.937815 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 538/1090] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:53 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:54.962881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e29ca5b9-d03d-435a-a9b1-f4a8dd954bf7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:54.963517 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e29ca5b9-d03d-435a-a9b1-f4a8dd954bf7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:54.971982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e29ca5b9-d03d-435a-a9b1-f4a8dd954bf7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:54.972555 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e29ca5b9-d03d-435a-a9b1-f4a8dd954bf7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:54.972918 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e29ca5b9-d03d-435a-a9b1-f4a8dd954bf7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:54.973609 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e29ca5b9-d03d-435a-a9b1-f4a8dd954bf7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:54.974301 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e29ca5b9-d03d-435a-a9b1-f4a8dd954bf7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:54.974896 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e29ca5b9-d03d-435a-a9b1-f4a8dd954bf7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:55.203503 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e29ca5b9-d03d-435a-a9b1-f4a8dd954bf7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:55.211586 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e29ca5b9-d03d-435a-a9b1-f4a8dd954bf7 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.253602 Sep 13 06:49:55.212161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 553/1091] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:54 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:56.236796 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-14aacd05-71c1-4cec-b38d-203d93c6e9f2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:56.237412 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-14aacd05-71c1-4cec-b38d-203d93c6e9f2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:56.245936 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14aacd05-71c1-4cec-b38d-203d93c6e9f2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:56.246434 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14aacd05-71c1-4cec-b38d-203d93c6e9f2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:56.246870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14aacd05-71c1-4cec-b38d-203d93c6e9f2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:56.247603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14aacd05-71c1-4cec-b38d-203d93c6e9f2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:56.248056 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14aacd05-71c1-4cec-b38d-203d93c6e9f2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:56.248676 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14aacd05-71c1-4cec-b38d-203d93c6e9f2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:56.439634 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-14aacd05-71c1-4cec-b38d-203d93c6e9f2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:56.448331 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-14aacd05-71c1-4cec-b38d-203d93c6e9f2 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.216170 Sep 13 06:49:56.449041 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 539/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:56 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:57.472608 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-258b3cdd-099d-40be-ac16-d4e89b1ec71b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:57.473911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-258b3cdd-099d-40be-ac16-d4e89b1ec71b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:57.480747 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-258b3cdd-099d-40be-ac16-d4e89b1ec71b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:57.481422 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-258b3cdd-099d-40be-ac16-d4e89b1ec71b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:57.482023 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-258b3cdd-099d-40be-ac16-d4e89b1ec71b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:57.482897 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-258b3cdd-099d-40be-ac16-d4e89b1ec71b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:57.483531 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-258b3cdd-099d-40be-ac16-d4e89b1ec71b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:57.484213 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-258b3cdd-099d-40be-ac16-d4e89b1ec71b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:57.649633 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-258b3cdd-099d-40be-ac16-d4e89b1ec71b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:57.657952 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-258b3cdd-099d-40be-ac16-d4e89b1ec71b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.189234 Sep 13 06:49:57.658535 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 554/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:57 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:58.682766 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b0cd1787-878f-425f-bb96-ae495b585996 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:58.683417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b0cd1787-878f-425f-bb96-ae495b585996 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:58.690507 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0cd1787-878f-425f-bb96-ae495b585996 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:58.690995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0cd1787-878f-425f-bb96-ae495b585996 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:58.691453 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0cd1787-878f-425f-bb96-ae495b585996 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:58.692341 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0cd1787-878f-425f-bb96-ae495b585996 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:58.692797 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0cd1787-878f-425f-bb96-ae495b585996 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:58.693223 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0cd1787-878f-425f-bb96-ae495b585996 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:58.909259 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b0cd1787-878f-425f-bb96-ae495b585996 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:49:58.917643 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b0cd1787-878f-425f-bb96-ae495b585996 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.239386 Sep 13 06:49:58.931895 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 540/1094] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:58 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:49:59.941313 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e51d1ba9-5dde-4808-a34a-72e87e9791d3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:49:59.942038 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e51d1ba9-5dde-4808-a34a-72e87e9791d3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:49:59.949760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e51d1ba9-5dde-4808-a34a-72e87e9791d3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:59.950326 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e51d1ba9-5dde-4808-a34a-72e87e9791d3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:59.950828 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e51d1ba9-5dde-4808-a34a-72e87e9791d3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:49:59.951671 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e51d1ba9-5dde-4808-a34a-72e87e9791d3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:49:59.952321 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e51d1ba9-5dde-4808-a34a-72e87e9791d3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:49:59.952813 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e51d1ba9-5dde-4808-a34a-72e87e9791d3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:00.138894 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e51d1ba9-5dde-4808-a34a-72e87e9791d3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:00.151582 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e51d1ba9-5dde-4808-a34a-72e87e9791d3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.213807 Sep 13 06:50:00.152583 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 555/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:49:59 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:01.180129 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c2e18465-cded-4edd-8799-9f87240d3645 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:01.181668 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c2e18465-cded-4edd-8799-9f87240d3645 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:01.191020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2e18465-cded-4edd-8799-9f87240d3645 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:01.191899 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2e18465-cded-4edd-8799-9f87240d3645 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:01.192625 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2e18465-cded-4edd-8799-9f87240d3645 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:01.193499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2e18465-cded-4edd-8799-9f87240d3645 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:01.194247 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2e18465-cded-4edd-8799-9f87240d3645 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:01.195415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c2e18465-cded-4edd-8799-9f87240d3645 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:01.343869 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c2e18465-cded-4edd-8799-9f87240d3645 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:01.352552 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c2e18465-cded-4edd-8799-9f87240d3645 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.177469 Sep 13 06:50:01.353144 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 541/1096] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:01 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:02.377841 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f3d4a0fd-3f38-4755-8c4b-5edacd6c9a8c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:02.378477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f3d4a0fd-3f38-4755-8c4b-5edacd6c9a8c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:02.382827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:02.388348 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f3d4a0fd-3f38-4755-8c4b-5edacd6c9a8c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:02.389538 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f3d4a0fd-3f38-4755-8c4b-5edacd6c9a8c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:02.390075 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f3d4a0fd-3f38-4755-8c4b-5edacd6c9a8c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:02.391256 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f3d4a0fd-3f38-4755-8c4b-5edacd6c9a8c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:02.391822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f3d4a0fd-3f38-4755-8c4b-5edacd6c9a8c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:02.392422 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f3d4a0fd-3f38-4755-8c4b-5edacd6c9a8c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:02.537013 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f3d4a0fd-3f38-4755-8c4b-5edacd6c9a8c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:02.545645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f3d4a0fd-3f38-4755-8c4b-5edacd6c9a8c tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1569 microversion: 2.1 time: 0.172160 Sep 13 06:50:02.546493 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 556/1097] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:02 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:02.568642 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9b98221e-5255-4ff9-97b8-1187f6a488cd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:02.569258 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9b98221e-5255-4ff9-97b8-1187f6a488cd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:02.572314 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:02.577922 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b98221e-5255-4ff9-97b8-1187f6a488cd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:02.578416 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b98221e-5255-4ff9-97b8-1187f6a488cd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:02.578866 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b98221e-5255-4ff9-97b8-1187f6a488cd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:02.580038 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b98221e-5255-4ff9-97b8-1187f6a488cd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:02.580503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b98221e-5255-4ff9-97b8-1187f6a488cd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:02.580938 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b98221e-5255-4ff9-97b8-1187f6a488cd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:02.612911 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9b98221e-5255-4ff9-97b8-1187f6a488cd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132398) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 06:50:02.684603 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9b98221e-5255-4ff9-97b8-1187f6a488cd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "POST /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b/action" status: 202 len: 0 microversion: 2.1 time: 0.119498 Sep 13 06:50:02.685221 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 542/1098] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Sep 13 06:50:02 2022] POST /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:50:02.693418 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3ace367a-7e14-4538-b18d-f1323621962d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:02.694025 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3ace367a-7e14-4538-b18d-f1323621962d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:02.700505 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ace367a-7e14-4538-b18d-f1323621962d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:02.700994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ace367a-7e14-4538-b18d-f1323621962d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:02.701424 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ace367a-7e14-4538-b18d-f1323621962d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:02.702120 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ace367a-7e14-4538-b18d-f1323621962d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:02.702575 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ace367a-7e14-4538-b18d-f1323621962d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:02.702994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3ace367a-7e14-4538-b18d-f1323621962d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:02.855432 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3ace367a-7e14-4538-b18d-f1323621962d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:02.865287 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3ace367a-7e14-4538-b18d-f1323621962d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1517 microversion: 2.1 time: 0.175609 Sep 13 06:50:02.866402 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 557/1099] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:02 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:50:03.456268 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-dee934da-1cca-4fc7-8348-872cc43527f7 req-cdbd3f17-a6ee-43b8-be15-3c17b1d23a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd6a470-5bbf-4d29-b5e2-860f8f7c551b", "name": "network-vif-unplugged", "status": "completed", "tag": "35c33167-d432-4f8a-b748-145b6562d972"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:03.478635 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-dee934da-1cca-4fc7-8348-872cc43527f7 req-cdbd3f17-a6ee-43b8-be15-3c17b1d23a43 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:03.481292 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-dee934da-1cca-4fc7-8348-872cc43527f7 req-cdbd3f17-a6ee-43b8-be15-3c17b1d23a43 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:03.481753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-dee934da-1cca-4fc7-8348-872cc43527f7 req-cdbd3f17-a6ee-43b8-be15-3c17b1d23a43 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:03.513083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.compute.server_external_events [req-dee934da-1cca-4fc7-8348-872cc43527f7 req-cdbd3f17-a6ee-43b8-be15-3c17b1d23a43 service nova] Unable to find a host for instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b. Dropping event network-vif-unplugged {{(pid=132398) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 06:50:03.514354 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-dee934da-1cca-4fc7-8348-872cc43527f7 req-cdbd3f17-a6ee-43b8-be15-3c17b1d23a43 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.061809 Sep 13 06:50:03.521089 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 543/1100] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 06:50:03.890546 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bebcd959-83a5-4a9b-bf74-2a46851f7ca5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:03.891095 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-bebcd959-83a5-4a9b-bf74-2a46851f7ca5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:03.897413 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bebcd959-83a5-4a9b-bf74-2a46851f7ca5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:03.897910 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bebcd959-83a5-4a9b-bf74-2a46851f7ca5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:03.898341 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bebcd959-83a5-4a9b-bf74-2a46851f7ca5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:03.899020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bebcd959-83a5-4a9b-bf74-2a46851f7ca5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:03.899568 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bebcd959-83a5-4a9b-bf74-2a46851f7ca5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:03.899987 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bebcd959-83a5-4a9b-bf74-2a46851f7ca5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:04.027136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-bebcd959-83a5-4a9b-bf74-2a46851f7ca5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:04.034759 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-bebcd959-83a5-4a9b-bf74-2a46851f7ca5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1519 microversion: 2.1 time: 0.148156 Sep 13 06:50:04.035324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 558/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:03 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:05.058131 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3a0d08c9-e5ff-4f2c-84d9-dc321e4f9117 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:05.058744 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3a0d08c9-e5ff-4f2c-84d9-dc321e4f9117 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:05.065602 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a0d08c9-e5ff-4f2c-84d9-dc321e4f9117 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:05.066089 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a0d08c9-e5ff-4f2c-84d9-dc321e4f9117 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:05.066530 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a0d08c9-e5ff-4f2c-84d9-dc321e4f9117 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:05.067198 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a0d08c9-e5ff-4f2c-84d9-dc321e4f9117 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:05.067678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a0d08c9-e5ff-4f2c-84d9-dc321e4f9117 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:05.068100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3a0d08c9-e5ff-4f2c-84d9-dc321e4f9117 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:05.209118 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3a0d08c9-e5ff-4f2c-84d9-dc321e4f9117 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:05.217657 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3a0d08c9-e5ff-4f2c-84d9-dc321e4f9117 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.163961 Sep 13 06:50:05.218222 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 544/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:05 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:06.240695 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fce0aeef-0b1a-412c-8a54-892a0a003ff3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:06.241286 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-fce0aeef-0b1a-412c-8a54-892a0a003ff3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:06.247579 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fce0aeef-0b1a-412c-8a54-892a0a003ff3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:06.248056 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fce0aeef-0b1a-412c-8a54-892a0a003ff3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:06.248480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fce0aeef-0b1a-412c-8a54-892a0a003ff3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:06.249164 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fce0aeef-0b1a-412c-8a54-892a0a003ff3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:06.249613 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fce0aeef-0b1a-412c-8a54-892a0a003ff3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:06.250029 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fce0aeef-0b1a-412c-8a54-892a0a003ff3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:06.386979 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fce0aeef-0b1a-412c-8a54-892a0a003ff3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:06.395458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fce0aeef-0b1a-412c-8a54-892a0a003ff3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.158553 Sep 13 06:50:06.396028 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 559/1103] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:06 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:07.419498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-44a93c9c-5a42-4cc8-b791-cd26ad606fb0 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:07.420140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-44a93c9c-5a42-4cc8-b791-cd26ad606fb0 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:07.426433 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44a93c9c-5a42-4cc8-b791-cd26ad606fb0 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:07.426913 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44a93c9c-5a42-4cc8-b791-cd26ad606fb0 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:07.427344 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44a93c9c-5a42-4cc8-b791-cd26ad606fb0 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:07.428085 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44a93c9c-5a42-4cc8-b791-cd26ad606fb0 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:07.428541 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44a93c9c-5a42-4cc8-b791-cd26ad606fb0 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:07.429524 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44a93c9c-5a42-4cc8-b791-cd26ad606fb0 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:07.564567 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-44a93c9c-5a42-4cc8-b791-cd26ad606fb0 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:07.572561 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-44a93c9c-5a42-4cc8-b791-cd26ad606fb0 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.157147 Sep 13 06:50:07.573125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 545/1104] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:07 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:08.595983 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-4035d2d9-726e-4d94-a01c-c5f2ca552c57 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:08.596710 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-4035d2d9-726e-4d94-a01c-c5f2ca552c57 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:08.603227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4035d2d9-726e-4d94-a01c-c5f2ca552c57 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:08.603775 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4035d2d9-726e-4d94-a01c-c5f2ca552c57 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:08.604211 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4035d2d9-726e-4d94-a01c-c5f2ca552c57 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:08.604908 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4035d2d9-726e-4d94-a01c-c5f2ca552c57 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:08.605366 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4035d2d9-726e-4d94-a01c-c5f2ca552c57 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:08.605786 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-4035d2d9-726e-4d94-a01c-c5f2ca552c57 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:08.750467 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-4035d2d9-726e-4d94-a01c-c5f2ca552c57 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:08.762127 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-4035d2d9-726e-4d94-a01c-c5f2ca552c57 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.170145 Sep 13 06:50:08.763454 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 560/1105] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:08 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:09.786209 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2df0deda-c61c-451e-88f8-6a6aad97e36d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:09.786816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2df0deda-c61c-451e-88f8-6a6aad97e36d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:09.793678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2df0deda-c61c-451e-88f8-6a6aad97e36d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:09.794163 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2df0deda-c61c-451e-88f8-6a6aad97e36d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:09.794629 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2df0deda-c61c-451e-88f8-6a6aad97e36d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:09.795321 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2df0deda-c61c-451e-88f8-6a6aad97e36d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:09.795802 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2df0deda-c61c-451e-88f8-6a6aad97e36d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:09.796228 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2df0deda-c61c-451e-88f8-6a6aad97e36d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:09.908258 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1585870333", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "networks": [{"uuid": "0e7e8d4c-9c8f-4bed-8b88-e0a038cbf6c6"}]}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:09.927517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2df0deda-c61c-451e-88f8-6a6aad97e36d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:09.935785 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2df0deda-c61c-451e-88f8-6a6aad97e36d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.153567 Sep 13 06:50:09.936438 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 546/1106] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:09 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:09.963936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.network.neutron [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] validate_networks() for [('0e7e8d4c-9c8f-4bed-8b88-e0a038cbf6c6', None, None, None, None, None)] {{(pid=132399) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:50:10.371345 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Flavor limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:50:10.371794 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Image limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:50:10.372273 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Flavor pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:50:10.372685 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Image pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:50:10.373183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:50:10.381831 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:10.382821 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:10.383262 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:10.384022 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:10.384479 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:10.384907 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:10.391530 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:10.402986 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Getting quotas for project da88371a3e1a436caea7f0e7a6117eb2. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:50:10.406930 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Getting quotas for user 5f2e5d889fd24bdfba78f1cbe7dd181d and project da88371a3e1a436caea7f0e7a6117eb2. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:50:10.417837 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Going to run 1 instances... {{(pid=132399) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:50:10.420141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:50:10.467498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f0cf0a8c-945c-4202-ab93-a37b23099b86 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562976 Sep 13 06:50:10.468159 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 561/1107] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 06:50:10.479059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-379ed639-2111-46c0-a05a-16cc51b7cd0c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:10.479698 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-379ed639-2111-46c0-a05a-16cc51b7cd0c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:10.531632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-379ed639-2111-46c0-a05a-16cc51b7cd0c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:10.538480 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-379ed639-2111-46c0-a05a-16cc51b7cd0c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1214 microversion: 2.1 time: 0.063259 Sep 13 06:50:10.539077 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 547/1108] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:10 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:10.961342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-e25c6c37-325a-425f-930f-a7a9009edabd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:10.961958 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-e25c6c37-325a-425f-930f-a7a9009edabd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:10.968701 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e25c6c37-325a-425f-930f-a7a9009edabd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:10.969192 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e25c6c37-325a-425f-930f-a7a9009edabd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:10.969626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e25c6c37-325a-425f-930f-a7a9009edabd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:10.970315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e25c6c37-325a-425f-930f-a7a9009edabd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:10.970769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e25c6c37-325a-425f-930f-a7a9009edabd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:10.971195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-e25c6c37-325a-425f-930f-a7a9009edabd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:11.111492 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-e25c6c37-325a-425f-930f-a7a9009edabd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:11.120465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-e25c6c37-325a-425f-930f-a7a9009edabd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.164356 Sep 13 06:50:11.121091 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 562/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:10 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:11.561563 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-639697ca-31c3-4635-8ae4-49ac900096a9 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:11.562180 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-639697ca-31c3-4635-8ae4-49ac900096a9 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:11.570047 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639697ca-31c3-4635-8ae4-49ac900096a9 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:11.570754 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639697ca-31c3-4635-8ae4-49ac900096a9 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:11.571332 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639697ca-31c3-4635-8ae4-49ac900096a9 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:11.572785 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639697ca-31c3-4635-8ae4-49ac900096a9 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:11.573263 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639697ca-31c3-4635-8ae4-49ac900096a9 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:11.574081 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-639697ca-31c3-4635-8ae4-49ac900096a9 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:11.649729 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-639697ca-31c3-4635-8ae4-49ac900096a9 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:11.658063 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-639697ca-31c3-4635-8ae4-49ac900096a9 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1274 microversion: 2.1 time: 0.100419 Sep 13 06:50:11.659227 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 548/1110] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:11 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:12.143942 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-64db2fc7-5eaf-40c7-b888-3f91b34bdf8b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:12.144802 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-64db2fc7-5eaf-40c7-b888-3f91b34bdf8b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:12.151329 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64db2fc7-5eaf-40c7-b888-3f91b34bdf8b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:12.151877 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64db2fc7-5eaf-40c7-b888-3f91b34bdf8b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:12.152322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64db2fc7-5eaf-40c7-b888-3f91b34bdf8b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:12.153058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64db2fc7-5eaf-40c7-b888-3f91b34bdf8b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:12.153504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64db2fc7-5eaf-40c7-b888-3f91b34bdf8b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:12.153923 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-64db2fc7-5eaf-40c7-b888-3f91b34bdf8b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:12.358707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-64db2fc7-5eaf-40c7-b888-3f91b34bdf8b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:12.367132 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-64db2fc7-5eaf-40c7-b888-3f91b34bdf8b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.226536 Sep 13 06:50:12.368030 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 563/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:12 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:12.682705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-a8eefbe1-6915-47fe-82ce-e4180278083a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:12.683312 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-a8eefbe1-6915-47fe-82ce-e4180278083a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:12.689942 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a8eefbe1-6915-47fe-82ce-e4180278083a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:12.690453 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a8eefbe1-6915-47fe-82ce-e4180278083a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:12.690893 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a8eefbe1-6915-47fe-82ce-e4180278083a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:12.691628 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a8eefbe1-6915-47fe-82ce-e4180278083a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:12.692091 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a8eefbe1-6915-47fe-82ce-e4180278083a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:12.692517 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-a8eefbe1-6915-47fe-82ce-e4180278083a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:12.819493 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-a8eefbe1-6915-47fe-82ce-e4180278083a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:12.827093 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-a8eefbe1-6915-47fe-82ce-e4180278083a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1314 microversion: 2.1 time: 0.148918 Sep 13 06:50:12.827795 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 549/1112] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:12 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:13.390324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-8abe33c4-855a-49ee-abb7-8b50d96d00bd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:13.391581 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-8abe33c4-855a-49ee-abb7-8b50d96d00bd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:13.398683 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8abe33c4-855a-49ee-abb7-8b50d96d00bd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:13.399163 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8abe33c4-855a-49ee-abb7-8b50d96d00bd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:13.399626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8abe33c4-855a-49ee-abb7-8b50d96d00bd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:13.400319 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8abe33c4-855a-49ee-abb7-8b50d96d00bd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:13.400994 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8abe33c4-855a-49ee-abb7-8b50d96d00bd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:13.401170 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-8abe33c4-855a-49ee-abb7-8b50d96d00bd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:13.601285 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-8abe33c4-855a-49ee-abb7-8b50d96d00bd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:13.608911 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-8abe33c4-855a-49ee-abb7-8b50d96d00bd tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.222743 Sep 13 06:50:13.609474 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 564/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:13 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:13.839968 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-1beb879c-3b2b-45a9-9440-ac178d02f588 req-a91bd017-6724-40ac-a74e-93b5ffeee8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c70569-c01a-4833-976e-27df4b88b460", "tag": "73adb7d9-6ada-4177-994d-246f23529ef0"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:13.849730 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-1beb879c-3b2b-45a9-9440-ac178d02f588 req-a91bd017-6724-40ac-a74e-93b5ffeee8c8 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:13.850221 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-1beb879c-3b2b-45a9-9440-ac178d02f588 req-a91bd017-6724-40ac-a74e-93b5ffeee8c8 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:13.850432 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5668db02-0f95-4a96-ae8b-df746fb3aea1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:13.850654 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-1beb879c-3b2b-45a9-9440-ac178d02f588 req-a91bd017-6724-40ac-a74e-93b5ffeee8c8 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:13.851274 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5668db02-0f95-4a96-ae8b-df746fb3aea1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:13.857850 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5668db02-0f95-4a96-ae8b-df746fb3aea1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:13.858329 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5668db02-0f95-4a96-ae8b-df746fb3aea1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:13.858758 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5668db02-0f95-4a96-ae8b-df746fb3aea1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:13.859552 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5668db02-0f95-4a96-ae8b-df746fb3aea1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:13.859958 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5668db02-0f95-4a96-ae8b-df746fb3aea1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:13.860377 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5668db02-0f95-4a96-ae8b-df746fb3aea1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:13.861404 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-1beb879c-3b2b-45a9-9440-ac178d02f588 req-a91bd017-6724-40ac-a74e-93b5ffeee8c8 service nova] Creating event network-changed:73adb7d9-6ada-4177-994d-246f23529ef0 for instance d4c70569-c01a-4833-976e-27df4b88b460 on hv-cinder-85638 Sep 13 06:50:13.866794 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-1beb879c-3b2b-45a9-9440-ac178d02f588 req-a91bd017-6724-40ac-a74e-93b5ffeee8c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160674 Sep 13 06:50:13.867786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 550/1114] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:50:14.069387 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5668db02-0f95-4a96-ae8b-df746fb3aea1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:14.077221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5668db02-0f95-4a96-ae8b-df746fb3aea1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1314 microversion: 2.1 time: 0.231022 Sep 13 06:50:14.078125 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 565/1115] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:13 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:50:14.633670 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-feb8de74-b8b6-4424-b7ed-a785592490f5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:14.634895 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-feb8de74-b8b6-4424-b7ed-a785592490f5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:14.642052 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-feb8de74-b8b6-4424-b7ed-a785592490f5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:14.642553 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-feb8de74-b8b6-4424-b7ed-a785592490f5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:14.642983 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-feb8de74-b8b6-4424-b7ed-a785592490f5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:14.643710 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-feb8de74-b8b6-4424-b7ed-a785592490f5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:14.644203 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-feb8de74-b8b6-4424-b7ed-a785592490f5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:14.644634 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-feb8de74-b8b6-4424-b7ed-a785592490f5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:14.775864 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-feb8de74-b8b6-4424-b7ed-a785592490f5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:14.783581 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-feb8de74-b8b6-4424-b7ed-a785592490f5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.154712 Sep 13 06:50:14.784143 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 551/1116] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:14 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:15.099630 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f58ccbf6-114d-41a0-820d-ab0a32343754 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:15.100267 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f58ccbf6-114d-41a0-820d-ab0a32343754 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:15.107162 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f58ccbf6-114d-41a0-820d-ab0a32343754 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:15.107672 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f58ccbf6-114d-41a0-820d-ab0a32343754 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:15.108103 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f58ccbf6-114d-41a0-820d-ab0a32343754 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:15.108794 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f58ccbf6-114d-41a0-820d-ab0a32343754 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:15.109420 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f58ccbf6-114d-41a0-820d-ab0a32343754 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:15.109842 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f58ccbf6-114d-41a0-820d-ab0a32343754 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:15.240936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f58ccbf6-114d-41a0-820d-ab0a32343754 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:15.248996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f58ccbf6-114d-41a0-820d-ab0a32343754 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1314 microversion: 2.1 time: 0.153179 Sep 13 06:50:15.249697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 566/1117] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:15 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:15.806083 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e21d3cb8-5bf8-47fa-8494-4fccdc96b599 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:15.806828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e21d3cb8-5bf8-47fa-8494-4fccdc96b599 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:15.813317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e21d3cb8-5bf8-47fa-8494-4fccdc96b599 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:15.813801 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e21d3cb8-5bf8-47fa-8494-4fccdc96b599 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:15.814239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e21d3cb8-5bf8-47fa-8494-4fccdc96b599 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:15.814922 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e21d3cb8-5bf8-47fa-8494-4fccdc96b599 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:15.815399 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e21d3cb8-5bf8-47fa-8494-4fccdc96b599 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:15.815829 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e21d3cb8-5bf8-47fa-8494-4fccdc96b599 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:15.949856 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e21d3cb8-5bf8-47fa-8494-4fccdc96b599 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:15.957650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e21d3cb8-5bf8-47fa-8494-4fccdc96b599 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.155477 Sep 13 06:50:15.958213 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 552/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:15 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:16.272520 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d8299084-8185-4aae-ad69-8d7b3458932e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:16.273113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d8299084-8185-4aae-ad69-8d7b3458932e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:16.279383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8299084-8185-4aae-ad69-8d7b3458932e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:16.279881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8299084-8185-4aae-ad69-8d7b3458932e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:16.280315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8299084-8185-4aae-ad69-8d7b3458932e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:16.281003 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8299084-8185-4aae-ad69-8d7b3458932e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:16.281451 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8299084-8185-4aae-ad69-8d7b3458932e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:16.281873 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d8299084-8185-4aae-ad69-8d7b3458932e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:16.489153 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d8299084-8185-4aae-ad69-8d7b3458932e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:16.496733 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d8299084-8185-4aae-ad69-8d7b3458932e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1314 microversion: 2.1 time: 0.228058 Sep 13 06:50:16.497295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 567/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:16 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:16.980827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-6a65a766-4d89-4829-a570-9e3bb1c7a2a6 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:16.981437 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-6a65a766-4d89-4829-a570-9e3bb1c7a2a6 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:16.987924 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a65a766-4d89-4829-a570-9e3bb1c7a2a6 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:16.988410 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a65a766-4d89-4829-a570-9e3bb1c7a2a6 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:16.988845 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a65a766-4d89-4829-a570-9e3bb1c7a2a6 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:16.989537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a65a766-4d89-4829-a570-9e3bb1c7a2a6 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:16.989996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a65a766-4d89-4829-a570-9e3bb1c7a2a6 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:16.990423 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-6a65a766-4d89-4829-a570-9e3bb1c7a2a6 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:17.120446 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-6a65a766-4d89-4829-a570-9e3bb1c7a2a6 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:17.128396 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-6a65a766-4d89-4829-a570-9e3bb1c7a2a6 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.151351 Sep 13 06:50:17.128984 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 553/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:16 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:17.519942 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-be43139c-be60-4314-a0dc-d47c248a91f3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:17.520544 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-be43139c-be60-4314-a0dc-d47c248a91f3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:17.527640 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be43139c-be60-4314-a0dc-d47c248a91f3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:17.528111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be43139c-be60-4314-a0dc-d47c248a91f3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:17.528749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be43139c-be60-4314-a0dc-d47c248a91f3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:17.529436 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be43139c-be60-4314-a0dc-d47c248a91f3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:17.529885 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be43139c-be60-4314-a0dc-d47c248a91f3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:17.530304 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be43139c-be60-4314-a0dc-d47c248a91f3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:17.666619 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-be43139c-be60-4314-a0dc-d47c248a91f3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:17.672632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-a3fb41ad-ce69-44d9-986a-9c1fc0cc2919 req-94fd7812-f5ba-4af4-a1f1-be64e81fcdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd6a470-5bbf-4d29-b5e2-860f8f7c551b", "name": "network-vif-plugged", "status": "completed", "tag": "35c33167-d432-4f8a-b748-145b6562d972"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:17.676214 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-be43139c-be60-4314-a0dc-d47c248a91f3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1314 microversion: 2.1 time: 0.160205 Sep 13 06:50:17.676869 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 568/1121] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:17 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:17.682644 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a3fb41ad-ce69-44d9-986a-9c1fc0cc2919 req-94fd7812-f5ba-4af4-a1f1-be64e81fcdec service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:17.683178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a3fb41ad-ce69-44d9-986a-9c1fc0cc2919 req-94fd7812-f5ba-4af4-a1f1-be64e81fcdec service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:17.683754 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-a3fb41ad-ce69-44d9-986a-9c1fc0cc2919 req-94fd7812-f5ba-4af4-a1f1-be64e81fcdec service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:17.696483 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-a3fb41ad-ce69-44d9-986a-9c1fc0cc2919 req-94fd7812-f5ba-4af4-a1f1-be64e81fcdec service nova] Creating event network-vif-plugged:35c33167-d432-4f8a-b748-145b6562d972 for instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b on hv-cinder-85638 Sep 13 06:50:17.701705 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-a3fb41ad-ce69-44d9-986a-9c1fc0cc2919 req-94fd7812-f5ba-4af4-a1f1-be64e81fcdec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032810 Sep 13 06:50:17.702322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 554/1122] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:50:18.151856 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-29d82000-bc2f-4b97-b388-fdfbdec220af tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:18.152894 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-29d82000-bc2f-4b97-b388-fdfbdec220af tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:18.159388 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-29d82000-bc2f-4b97-b388-fdfbdec220af tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:18.159594 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-29d82000-bc2f-4b97-b388-fdfbdec220af tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:18.159913 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-29d82000-bc2f-4b97-b388-fdfbdec220af tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:18.160611 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-29d82000-bc2f-4b97-b388-fdfbdec220af tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:18.161057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-29d82000-bc2f-4b97-b388-fdfbdec220af tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:18.162046 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-29d82000-bc2f-4b97-b388-fdfbdec220af tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:18.324251 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-29d82000-bc2f-4b97-b388-fdfbdec220af tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:18.331869 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-29d82000-bc2f-4b97-b388-fdfbdec220af tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.184294 Sep 13 06:50:18.332439 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 569/1123] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:18 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:18.700768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-26a3acfd-7894-42aa-9e90-d53d9e212929 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:18.701528 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-26a3acfd-7894-42aa-9e90-d53d9e212929 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:18.708106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26a3acfd-7894-42aa-9e90-d53d9e212929 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:18.708594 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26a3acfd-7894-42aa-9e90-d53d9e212929 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:18.709033 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26a3acfd-7894-42aa-9e90-d53d9e212929 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:18.709721 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26a3acfd-7894-42aa-9e90-d53d9e212929 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:18.710182 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26a3acfd-7894-42aa-9e90-d53d9e212929 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:18.710609 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-26a3acfd-7894-42aa-9e90-d53d9e212929 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:18.841697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-26a3acfd-7894-42aa-9e90-d53d9e212929 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:18.849539 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-26a3acfd-7894-42aa-9e90-d53d9e212929 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1314 microversion: 2.1 time: 0.152974 Sep 13 06:50:18.850107 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 555/1124] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:18 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:19.355767 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-63a97748-01af-432b-b819-93bf5bed2d7d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:19.356373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-63a97748-01af-432b-b819-93bf5bed2d7d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:19.362711 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-63a97748-01af-432b-b819-93bf5bed2d7d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:19.363186 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-63a97748-01af-432b-b819-93bf5bed2d7d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:19.363651 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-63a97748-01af-432b-b819-93bf5bed2d7d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:19.364332 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-63a97748-01af-432b-b819-93bf5bed2d7d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:19.364781 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-63a97748-01af-432b-b819-93bf5bed2d7d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:19.365198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-63a97748-01af-432b-b819-93bf5bed2d7d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:19.502089 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-63a97748-01af-432b-b819-93bf5bed2d7d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:19.509831 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-63a97748-01af-432b-b819-93bf5bed2d7d tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1575 microversion: 2.1 time: 0.157931 Sep 13 06:50:19.510400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 570/1125] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:19 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:19.717925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-24408e92-ccea-4925-9423-3c47501c9fe3 req-729e1bb2-d47f-48f9-a40f-61319e307bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c70569-c01a-4833-976e-27df4b88b460", "name": "network-vif-plugged", "status": "completed", "tag": "73adb7d9-6ada-4177-994d-246f23529ef0"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:19.728578 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-24408e92-ccea-4925-9423-3c47501c9fe3 req-729e1bb2-d47f-48f9-a40f-61319e307bb1 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:19.729043 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-24408e92-ccea-4925-9423-3c47501c9fe3 req-729e1bb2-d47f-48f9-a40f-61319e307bb1 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:19.729919 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-24408e92-ccea-4925-9423-3c47501c9fe3 req-729e1bb2-d47f-48f9-a40f-61319e307bb1 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:19.742377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-24408e92-ccea-4925-9423-3c47501c9fe3 req-729e1bb2-d47f-48f9-a40f-61319e307bb1 service nova] Creating event network-vif-plugged:73adb7d9-6ada-4177-994d-246f23529ef0 for instance d4c70569-c01a-4833-976e-27df4b88b460 on hv-cinder-85638 Sep 13 06:50:19.747306 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-24408e92-ccea-4925-9423-3c47501c9fe3 req-729e1bb2-d47f-48f9-a40f-61319e307bb1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033017 Sep 13 06:50:19.747907 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 556/1126] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:50:19.872635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-703bfee2-d132-4b23-b935-9f3a4ed3d926 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:19.873183 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-703bfee2-d132-4b23-b935-9f3a4ed3d926 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:19.879016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-703bfee2-d132-4b23-b935-9f3a4ed3d926 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:19.879542 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-703bfee2-d132-4b23-b935-9f3a4ed3d926 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:19.879977 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-703bfee2-d132-4b23-b935-9f3a4ed3d926 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:19.880663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-703bfee2-d132-4b23-b935-9f3a4ed3d926 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:19.881116 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-703bfee2-d132-4b23-b935-9f3a4ed3d926 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:19.881547 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-703bfee2-d132-4b23-b935-9f3a4ed3d926 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:20.009970 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-703bfee2-d132-4b23-b935-9f3a4ed3d926 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:20.018195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-703bfee2-d132-4b23-b935-9f3a4ed3d926 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1314 microversion: 2.1 time: 0.149423 Sep 13 06:50:20.018963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 571/1127] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:19 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:20.533794 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-dbb908f0-224f-43e0-bfc9-92c124305695 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:20.534491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-dbb908f0-224f-43e0-bfc9-92c124305695 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:20.536452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:20.542184 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dbb908f0-224f-43e0-bfc9-92c124305695 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:20.542667 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dbb908f0-224f-43e0-bfc9-92c124305695 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:20.543100 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dbb908f0-224f-43e0-bfc9-92c124305695 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:20.543816 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dbb908f0-224f-43e0-bfc9-92c124305695 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:20.544272 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dbb908f0-224f-43e0-bfc9-92c124305695 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:20.544692 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dbb908f0-224f-43e0-bfc9-92c124305695 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:20.675063 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dbb908f0-224f-43e0-bfc9-92c124305695 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:20.683655 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-dbb908f0-224f-43e0-bfc9-92c124305695 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1562 microversion: 2.1 time: 0.153645 Sep 13 06:50:20.684411 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 557/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:20 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:21.042357 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-65d0d64a-490f-45c9-a66f-7e6705af952d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:21.043020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-65d0d64a-490f-45c9-a66f-7e6705af952d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:21.045710 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:21.047273 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=6 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:21.053272 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65d0d64a-490f-45c9-a66f-7e6705af952d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:21.054400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65d0d64a-490f-45c9-a66f-7e6705af952d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:21.054877 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65d0d64a-490f-45c9-a66f-7e6705af952d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:21.055624 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65d0d64a-490f-45c9-a66f-7e6705af952d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:21.056086 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65d0d64a-490f-45c9-a66f-7e6705af952d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:21.056511 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-65d0d64a-490f-45c9-a66f-7e6705af952d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:21.181859 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-65d0d64a-490f-45c9-a66f-7e6705af952d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:21.189497 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-65d0d64a-490f-45c9-a66f-7e6705af952d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1314 microversion: 2.1 time: 0.151928 Sep 13 06:50:21.190062 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 572/1129] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:21 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:22.213580 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-4a687ef6-d6c0-4202-947b-0534e03b35e1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:22.214196 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-4a687ef6-d6c0-4202-947b-0534e03b35e1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:22.220675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a687ef6-d6c0-4202-947b-0534e03b35e1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:22.221163 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a687ef6-d6c0-4202-947b-0534e03b35e1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:22.222193 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a687ef6-d6c0-4202-947b-0534e03b35e1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:22.222904 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a687ef6-d6c0-4202-947b-0534e03b35e1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:22.223386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a687ef6-d6c0-4202-947b-0534e03b35e1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:22.223818 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-4a687ef6-d6c0-4202-947b-0534e03b35e1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:22.226975 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:22.363191 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-4a687ef6-d6c0-4202-947b-0534e03b35e1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:22.370846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-4a687ef6-d6c0-4202-947b-0534e03b35e1 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1314 microversion: 2.1 time: 0.161628 Sep 13 06:50:22.371430 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 558/1130] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:22 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:23.393400 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d5a57ed8-72f7-4ecb-a535-d98ca252d169 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:23.394067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d5a57ed8-72f7-4ecb-a535-d98ca252d169 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:23.400300 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5a57ed8-72f7-4ecb-a535-d98ca252d169 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:23.400777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5a57ed8-72f7-4ecb-a535-d98ca252d169 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:23.401205 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5a57ed8-72f7-4ecb-a535-d98ca252d169 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:23.401910 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5a57ed8-72f7-4ecb-a535-d98ca252d169 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:23.402340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5a57ed8-72f7-4ecb-a535-d98ca252d169 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:23.402765 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d5a57ed8-72f7-4ecb-a535-d98ca252d169 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:23.528322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-d5a57ed8-72f7-4ecb-a535-d98ca252d169 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:23.535770 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d5a57ed8-72f7-4ecb-a535-d98ca252d169 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1498 microversion: 2.1 time: 0.146184 Sep 13 06:50:23.536330 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 573/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:23 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1498 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:24.056052 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-562a62e5-29b8-46db-b949-080563112c38 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:24.056547 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-562a62e5-29b8-46db-b949-080563112c38 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:24.062840 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-562a62e5-29b8-46db-b949-080563112c38 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:24.063325 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-562a62e5-29b8-46db-b949-080563112c38 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:24.063791 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-562a62e5-29b8-46db-b949-080563112c38 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:24.064482 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-562a62e5-29b8-46db-b949-080563112c38 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:24.064938 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-562a62e5-29b8-46db-b949-080563112c38 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:24.065363 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-562a62e5-29b8-46db-b949-080563112c38 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:24.090529 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-562a62e5-29b8-46db-b949-080563112c38 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Going to try to terminate instance {{(pid=132398) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:50:24.165590 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-562a62e5-29b8-46db-b949-080563112c38 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 204 len: 0 microversion: 2.1 time: 0.113129 Sep 13 06:50:24.166680 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 559/1132] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:50:24 2022] DELETE /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:50:24.174541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2fc21d97-cce4-49f5-b149-2640ac6d2777 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:24.175149 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2fc21d97-cce4-49f5-b149-2640ac6d2777 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:24.181679 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2fc21d97-cce4-49f5-b149-2640ac6d2777 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:24.182156 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2fc21d97-cce4-49f5-b149-2640ac6d2777 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:24.182585 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2fc21d97-cce4-49f5-b149-2640ac6d2777 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:24.183295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2fc21d97-cce4-49f5-b149-2640ac6d2777 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:24.183773 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2fc21d97-cce4-49f5-b149-2640ac6d2777 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:24.184191 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2fc21d97-cce4-49f5-b149-2640ac6d2777 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:24.312059 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2fc21d97-cce4-49f5-b149-2640ac6d2777 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:24.320231 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2fc21d97-cce4-49f5-b149-2640ac6d2777 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1504 microversion: 2.1 time: 0.148926 Sep 13 06:50:24.320790 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 574/1133] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:24 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:25.344096 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5f89b0ef-0b08-4cb5-97d8-651328fae3a3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:25.344966 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5f89b0ef-0b08-4cb5-97d8-651328fae3a3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:25.352034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f89b0ef-0b08-4cb5-97d8-651328fae3a3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:25.352523 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f89b0ef-0b08-4cb5-97d8-651328fae3a3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:25.352963 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f89b0ef-0b08-4cb5-97d8-651328fae3a3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:25.353657 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f89b0ef-0b08-4cb5-97d8-651328fae3a3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:25.354117 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f89b0ef-0b08-4cb5-97d8-651328fae3a3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:25.354545 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5f89b0ef-0b08-4cb5-97d8-651328fae3a3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:25.492887 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5f89b0ef-0b08-4cb5-97d8-651328fae3a3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:25.500568 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5f89b0ef-0b08-4cb5-97d8-651328fae3a3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1504 microversion: 2.1 time: 0.161042 Sep 13 06:50:25.501133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 560/1134] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:25 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:26.525921 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0c53c59e-979e-4559-bbe2-bfa800223bff tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:26.527385 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0c53c59e-979e-4559-bbe2-bfa800223bff tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:26.533941 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0c53c59e-979e-4559-bbe2-bfa800223bff tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:26.534710 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0c53c59e-979e-4559-bbe2-bfa800223bff tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:26.535310 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0c53c59e-979e-4559-bbe2-bfa800223bff tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:26.536223 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0c53c59e-979e-4559-bbe2-bfa800223bff tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:26.536764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0c53c59e-979e-4559-bbe2-bfa800223bff tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:26.537365 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0c53c59e-979e-4559-bbe2-bfa800223bff tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:26.583204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-51d87d66-6e2d-4778-b298-2f2738841fb9 req-e4390c42-29af-44ab-94dc-36f8db17fdfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c70569-c01a-4833-976e-27df4b88b460", "name": "network-vif-deleted", "tag": "73adb7d9-6ada-4177-994d-246f23529ef0"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:26.598795 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-51d87d66-6e2d-4778-b298-2f2738841fb9 req-e4390c42-29af-44ab-94dc-36f8db17fdfa service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:26.601371 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-51d87d66-6e2d-4778-b298-2f2738841fb9 req-e4390c42-29af-44ab-94dc-36f8db17fdfa service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:26.601371 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-51d87d66-6e2d-4778-b298-2f2738841fb9 req-e4390c42-29af-44ab-94dc-36f8db17fdfa service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:26.614260 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0c53c59e-979e-4559-bbe2-bfa800223bff tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:26.618158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-51d87d66-6e2d-4778-b298-2f2738841fb9 req-e4390c42-29af-44ab-94dc-36f8db17fdfa service nova] Creating event network-vif-deleted:73adb7d9-6ada-4177-994d-246f23529ef0 for instance d4c70569-c01a-4833-976e-27df4b88b460 on hv-cinder-85638 Sep 13 06:50:26.622435 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0c53c59e-979e-4559-bbe2-bfa800223bff tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 200 len: 1462 microversion: 2.1 time: 0.102235 Sep 13 06:50:26.623014 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 575/1135] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:26 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 1462 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:26.624837 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-51d87d66-6e2d-4778-b298-2f2738841fb9 req-e4390c42-29af-44ab-94dc-36f8db17fdfa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045457 Sep 13 06:50:26.625424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 561/1136] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:50:27.645585 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:27.646225 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: d4c70569-c01a-4833-976e-27df4b88b460] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:27.653583 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:27.654068 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:27.654533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:27.655232 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:27.655734 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:27.656190 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:27.669854 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] HTTP exception thrown: Instance d4c70569-c01a-4833-976e-27df4b88b460 could not be found. Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Request method failure captured: Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 HTTP/1.1 Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICggcdCrVVpfirHpRtXuWa_9tFBOaUpimJzFRNMd9PqFb1t94rdflvN0EYjoCk-GpnwOF5hfeOd6pCcpioZxhS8TWJR1z4_UQNrbhgyMnZzqgyGwl-OFE9_o5Ra_HlzhzK1hEmx0q1nHGVn6swDcmbxmt70g8Y2wTB9lMwlcB655aws Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: da88371a3e1a436caea7f0e7a6117eb2 Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-VolumesActionsTest-2044278456 Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:50:27.671336 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/da88371a3e1a436caea7f0e7a6117eb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/da88371a3e1a436caea7f0e7a6117eb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/da88371a3e1a436caea7f0e7a6117eb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_da88371a3e1a436caea7f0e7a6117eb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-VolumesActionsTest-2044278456 Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: da88371a3e1a436caea7f0e7a6117eb2 Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-VolumesActionsTest-2044278456 Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-VolumesActionsTest-2044278456-project Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 5f2e5d889fd24bdfba78f1cbe7dd181d Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-VolumesActionsTest-2044278456-project Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance d4c70569-c01a-4833-976e-27df4b88b460 could not be found. Sep 13 06:50:27.673114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': 'd4c70569-c01a-4833-976e-27df4b88b460'} Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c70569-c01a-4833-976e-27df4b88b460 could not be found. Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:50:27.674886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c70569-c01a-4833-976e-27df4b88b460 could not be found. Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c70569-c01a-4833-976e-27df4b88b460 could not be found. Sep 13 06:50:27.676523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:27.677962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Returning 404 to user: Instance d4c70569-c01a-4833-976e-27df4b88b460 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:50:27.677962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2bd8374b-0ae7-4bc2-8583-f3d50589f458 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460" status: 404 len: 111 microversion: 2.1 time: 0.031141 Sep 13 06:50:27.677962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 576/1137] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:27 2022] GET /compute/v2.1/servers/d4c70569-c01a-4833-976e-27df4b88b460 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:50:27.722715 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1026673930", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "networks": [{"uuid": "0e7e8d4c-9c8f-4bed-8b88-e0a038cbf6c6"}]}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:27.774999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.network.neutron [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] validate_networks() for [('0e7e8d4c-9c8f-4bed-8b88-e0a038cbf6c6', None, None, None, None, None)] {{(pid=132398) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:50:28.173793 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Flavor limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:50:28.174211 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Image limits 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:50:28.174685 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Flavor pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:50:28.175084 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Image pref 0:0:0 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:50:28.175524 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.virt.hardware [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:50:28.184619 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:28.185023 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:28.185450 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:28.186201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:28.186653 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:28.187075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:28.203845 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Getting quotas for project da88371a3e1a436caea7f0e7a6117eb2. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:50:28.207786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.quota [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Getting quotas for user 5f2e5d889fd24bdfba78f1cbe7dd181d and project da88371a3e1a436caea7f0e7a6117eb2. Resources: {'instances', 'ram', 'cores'} {{(pid=132398) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:50:28.218315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Going to run 1 instances... {{(pid=132398) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:50:28.220694 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:50:28.266386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1874a119-ea0d-4207-baa4-e2c096763b48 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548363 Sep 13 06:50:28.267239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 562/1138] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Sep 13 06:50:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 06:50:28.277924 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2fcbf22a-5c97-45ce-9541-8152b2aece99 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:28.278529 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-2fcbf22a-5c97-45ce-9541-8152b2aece99 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:28.331538 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-2fcbf22a-5c97-45ce-9541-8152b2aece99 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:28.338522 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2fcbf22a-5c97-45ce-9541-8152b2aece99 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1214 microversion: 2.1 time: 0.064387 Sep 13 06:50:28.339112 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 577/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:28 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:29.362609 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0f081a0f-4e69-41dc-a303-fd340058996e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:29.363172 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0f081a0f-4e69-41dc-a303-fd340058996e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:29.372242 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f081a0f-4e69-41dc-a303-fd340058996e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:29.372784 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f081a0f-4e69-41dc-a303-fd340058996e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:29.373238 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f081a0f-4e69-41dc-a303-fd340058996e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:29.373909 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f081a0f-4e69-41dc-a303-fd340058996e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:29.374543 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f081a0f-4e69-41dc-a303-fd340058996e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:29.374965 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0f081a0f-4e69-41dc-a303-fd340058996e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:29.440175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0f081a0f-4e69-41dc-a303-fd340058996e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:29.451108 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0f081a0f-4e69-41dc-a303-fd340058996e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1274 microversion: 2.1 time: 0.092928 Sep 13 06:50:29.452041 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 563/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:29 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:30.478726 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1fca59e4-7b7d-4006-bf5a-84e386c80d88 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:30.479411 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1fca59e4-7b7d-4006-bf5a-84e386c80d88 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:30.486668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fca59e4-7b7d-4006-bf5a-84e386c80d88 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:30.487146 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fca59e4-7b7d-4006-bf5a-84e386c80d88 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:30.487613 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fca59e4-7b7d-4006-bf5a-84e386c80d88 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:30.488302 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fca59e4-7b7d-4006-bf5a-84e386c80d88 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:30.488752 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fca59e4-7b7d-4006-bf5a-84e386c80d88 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:30.489172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1fca59e4-7b7d-4006-bf5a-84e386c80d88 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:30.712141 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1fca59e4-7b7d-4006-bf5a-84e386c80d88 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:30.719699 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1fca59e4-7b7d-4006-bf5a-84e386c80d88 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1314 microversion: 2.1 time: 0.245433 Sep 13 06:50:30.720262 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 578/1141] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:30 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:30.870254 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-9fa7c69a-bf4d-4617-a083-d3fe96022489 req-07605005-9335-4bd2-9754-4686050296fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fac5a97-f2b3-44fa-87cd-9069a2a67ae8", "tag": "7ec8a575-b9e0-49df-bbf0-6dd67916ba03"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:30.886989 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-9fa7c69a-bf4d-4617-a083-d3fe96022489 req-07605005-9335-4bd2-9754-4686050296fa service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:30.887900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-9fa7c69a-bf4d-4617-a083-d3fe96022489 req-07605005-9335-4bd2-9754-4686050296fa service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:30.888338 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-9fa7c69a-bf4d-4617-a083-d3fe96022489 req-07605005-9335-4bd2-9754-4686050296fa service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:30.899941 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-9fa7c69a-bf4d-4617-a083-d3fe96022489 req-07605005-9335-4bd2-9754-4686050296fa service nova] Creating event network-changed:7ec8a575-b9e0-49df-bbf0-6dd67916ba03 for instance 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 on hv-cinder-85638 Sep 13 06:50:30.904798 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-9fa7c69a-bf4d-4617-a083-d3fe96022489 req-07605005-9335-4bd2-9754-4686050296fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038821 Sep 13 06:50:30.905391 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 564/1142] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:50:31.745308 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-6ed81f13-fd36-48bc-b07c-c48a6164e83a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:31.745976 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-6ed81f13-fd36-48bc-b07c-c48a6164e83a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:31.752268 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ed81f13-fd36-48bc-b07c-c48a6164e83a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:31.752742 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ed81f13-fd36-48bc-b07c-c48a6164e83a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:31.753196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ed81f13-fd36-48bc-b07c-c48a6164e83a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:31.753877 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ed81f13-fd36-48bc-b07c-c48a6164e83a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:31.754328 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ed81f13-fd36-48bc-b07c-c48a6164e83a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:31.754748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-6ed81f13-fd36-48bc-b07c-c48a6164e83a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:31.880085 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-6ed81f13-fd36-48bc-b07c-c48a6164e83a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:31.888478 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-6ed81f13-fd36-48bc-b07c-c48a6164e83a tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1314 microversion: 2.1 time: 0.147495 Sep 13 06:50:31.889026 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 579/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:31 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:32.911415 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-dd3c69f5-0742-4eeb-a347-e129fb67a07f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:32.912040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-dd3c69f5-0742-4eeb-a347-e129fb67a07f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:32.914028 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:32.919675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd3c69f5-0742-4eeb-a347-e129fb67a07f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:32.920157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd3c69f5-0742-4eeb-a347-e129fb67a07f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:32.920593 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd3c69f5-0742-4eeb-a347-e129fb67a07f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:32.921277 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd3c69f5-0742-4eeb-a347-e129fb67a07f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:32.921732 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd3c69f5-0742-4eeb-a347-e129fb67a07f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:32.922156 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dd3c69f5-0742-4eeb-a347-e129fb67a07f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:33.055278 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dd3c69f5-0742-4eeb-a347-e129fb67a07f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:33.062869 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-dd3c69f5-0742-4eeb-a347-e129fb67a07f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1314 microversion: 2.1 time: 0.156307 Sep 13 06:50:33.063462 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 565/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:32 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:33.823134 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-86c1a52c-8143-4950-9c26-17fc4ea31a5a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:33.823694 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-86c1a52c-8143-4950-9c26-17fc4ea31a5a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:33.827109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:33.830766 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86c1a52c-8143-4950-9c26-17fc4ea31a5a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:33.831284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86c1a52c-8143-4950-9c26-17fc4ea31a5a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:33.831777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86c1a52c-8143-4950-9c26-17fc4ea31a5a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:33.832660 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86c1a52c-8143-4950-9c26-17fc4ea31a5a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:33.833117 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86c1a52c-8143-4950-9c26-17fc4ea31a5a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:33.834129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-86c1a52c-8143-4950-9c26-17fc4ea31a5a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:33.837632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=100 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:33.865646 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-86c1a52c-8143-4950-9c26-17fc4ea31a5a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-volume_attachments/42a3f861-e969-4a22-af12-f2bc678f67dc" status: 200 len: 194 microversion: 2.20 time: 0.046330 Sep 13 06:50:33.866444 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 580/1145] 10.222.0.17 () {60 vars in 1454 bytes} [Tue Sep 13 06:50:33 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-volume_attachments/42a3f861-e969-4a22-af12-f2bc678f67dc => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:50:33.935010 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0fbd0ad4-b453-45c5-ab3e-c3c9a94eb639 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:33.935538 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0fbd0ad4-b453-45c5-ab3e-c3c9a94eb639 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:33.942057 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fbd0ad4-b453-45c5-ab3e-c3c9a94eb639 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:33.942486 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fbd0ad4-b453-45c5-ab3e-c3c9a94eb639 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:33.942921 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fbd0ad4-b453-45c5-ab3e-c3c9a94eb639 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:33.943651 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fbd0ad4-b453-45c5-ab3e-c3c9a94eb639 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:33.944114 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fbd0ad4-b453-45c5-ab3e-c3c9a94eb639 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:33.944538 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0fbd0ad4-b453-45c5-ab3e-c3c9a94eb639 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:34.026130 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.objects.instance [None req-0fbd0ad4-b453-45c5-ab3e-c3c9a94eb639 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lazy-loading 'services' on Instance uuid fd984c2d-db41-44f6-9324-394602908a4b {{(pid=132398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:50:34.085645 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-74290ffe-6e9f-48cf-b602-b21137c579e3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:34.086258 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-74290ffe-6e9f-48cf-b602-b21137c579e3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:34.092464 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74290ffe-6e9f-48cf-b602-b21137c579e3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:34.092945 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74290ffe-6e9f-48cf-b602-b21137c579e3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:34.093373 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74290ffe-6e9f-48cf-b602-b21137c579e3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:34.094056 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74290ffe-6e9f-48cf-b602-b21137c579e3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:34.094503 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74290ffe-6e9f-48cf-b602-b21137c579e3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:34.094919 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-74290ffe-6e9f-48cf-b602-b21137c579e3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:34.097891 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0fbd0ad4-b453-45c5-ab3e-c3c9a94eb639 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-volume_attachments/42a3f861-e969-4a22-af12-f2bc678f67dc" status: 202 len: 0 microversion: 2.20 time: 0.166744 Sep 13 06:50:34.098474 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 566/1146] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Sep 13 06:50:33 2022] DELETE /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-volume_attachments/42a3f861-e969-4a22-af12-f2bc678f67dc => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:50:34.107634 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2b42e3a5-00aa-4f80-9166-33e59e1859e7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:34.110076 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2b42e3a5-00aa-4f80-9166-33e59e1859e7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:34.116416 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b42e3a5-00aa-4f80-9166-33e59e1859e7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:34.116900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b42e3a5-00aa-4f80-9166-33e59e1859e7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:34.117332 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b42e3a5-00aa-4f80-9166-33e59e1859e7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:34.118020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b42e3a5-00aa-4f80-9166-33e59e1859e7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:34.118474 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b42e3a5-00aa-4f80-9166-33e59e1859e7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:34.118955 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b42e3a5-00aa-4f80-9166-33e59e1859e7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:34.154013 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2b42e3a5-00aa-4f80-9166-33e59e1859e7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050350 Sep 13 06:50:34.154589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 567/1147] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Sep 13 06:50:34 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 06:50:34.232389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-74290ffe-6e9f-48cf-b602-b21137c579e3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:34.240051 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-74290ffe-6e9f-48cf-b602-b21137c579e3 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1314 microversion: 2.1 time: 0.158871 Sep 13 06:50:34.240613 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 581/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:34 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:50:35.167297 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e715f5eb-b62b-40da-8777-95f642e6515b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:35.171154 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e715f5eb-b62b-40da-8777-95f642e6515b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:35.177891 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e715f5eb-b62b-40da-8777-95f642e6515b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:35.178364 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e715f5eb-b62b-40da-8777-95f642e6515b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:35.179395 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e715f5eb-b62b-40da-8777-95f642e6515b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:35.180104 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e715f5eb-b62b-40da-8777-95f642e6515b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:35.180597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e715f5eb-b62b-40da-8777-95f642e6515b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:35.181024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e715f5eb-b62b-40da-8777-95f642e6515b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:35.213898 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e715f5eb-b62b-40da-8777-95f642e6515b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051434 Sep 13 06:50:35.219754 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 568/1149] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Sep 13 06:50:35 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:35.262220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9409195b-e278-4dce-be1c-abc7c8e19f7f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:35.262768 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9409195b-e278-4dce-be1c-abc7c8e19f7f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:35.277304 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9409195b-e278-4dce-be1c-abc7c8e19f7f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:35.277857 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9409195b-e278-4dce-be1c-abc7c8e19f7f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:35.278243 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9409195b-e278-4dce-be1c-abc7c8e19f7f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:35.278948 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9409195b-e278-4dce-be1c-abc7c8e19f7f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:35.279548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9409195b-e278-4dce-be1c-abc7c8e19f7f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:35.279828 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9409195b-e278-4dce-be1c-abc7c8e19f7f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:35.300535 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e3cf4a53-ef2f-401f-b34c-f2c8b38e196f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:35.301175 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e3cf4a53-ef2f-401f-b34c-f2c8b38e196f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:35.307730 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e3cf4a53-ef2f-401f-b34c-f2c8b38e196f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:35.308431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e3cf4a53-ef2f-401f-b34c-f2c8b38e196f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:35.309040 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e3cf4a53-ef2f-401f-b34c-f2c8b38e196f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:35.309927 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e3cf4a53-ef2f-401f-b34c-f2c8b38e196f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:35.310548 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e3cf4a53-ef2f-401f-b34c-f2c8b38e196f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:35.311138 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e3cf4a53-ef2f-401f-b34c-f2c8b38e196f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:35.337961 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e3cf4a53-ef2f-401f-b34c-f2c8b38e196f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Going to try to terminate instance {{(pid=132398) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:50:35.420928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e3cf4a53-ef2f-401f-b34c-f2c8b38e196f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 204 len: 0 microversion: 2.20 time: 0.123735 Sep 13 06:50:35.421720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 569/1150] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Sep 13 06:50:35 2022] DELETE /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 06:50:35.425690 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9409195b-e278-4dce-be1c-abc7c8e19f7f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:35.434494 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9409195b-e278-4dce-be1c-abc7c8e19f7f tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1314 microversion: 2.1 time: 0.176042 Sep 13 06:50:35.434680 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:35.435304 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:35.435983 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 582/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:35 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:35.441054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:35.441530 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:35.441962 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:35.442778 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:35.443233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:35.443678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:35.593708 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:35.606491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:35.607992 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:35.609386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9b673cbb-e6db-400d-88fa-be5c716890cf tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.178798 Sep 13 06:50:35.610137 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 570/1152] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:35 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:36.458081 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fcb11ea8-b198-4275-b578-1ff41d8976de tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:36.458694 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-fcb11ea8-b198-4275-b578-1ff41d8976de tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:36.465615 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcb11ea8-b198-4275-b578-1ff41d8976de tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:36.466093 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcb11ea8-b198-4275-b578-1ff41d8976de tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:36.466524 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcb11ea8-b198-4275-b578-1ff41d8976de tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:36.467212 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcb11ea8-b198-4275-b578-1ff41d8976de tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:36.467698 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcb11ea8-b198-4275-b578-1ff41d8976de tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:36.468124 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fcb11ea8-b198-4275-b578-1ff41d8976de tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:36.595414 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fcb11ea8-b198-4275-b578-1ff41d8976de tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:36.603018 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fcb11ea8-b198-4275-b578-1ff41d8976de tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1314 microversion: 2.1 time: 0.148829 Sep 13 06:50:36.603602 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 583/1153] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:36 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:36.635283 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:36.635926 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:36.642267 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:36.642747 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:36.643181 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:36.643904 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:36.644361 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:36.644785 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:36.776122 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:36.784120 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:36.785565 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:36.786726 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3aa981f7-de67-44b3-b32b-6c107c61f87d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.155804 Sep 13 06:50:36.787284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 571/1154] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:36 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:37.625626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-71034414-0779-4d1b-bbc5-076d9780a7a4 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:37.626244 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-71034414-0779-4d1b-bbc5-076d9780a7a4 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:37.633111 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71034414-0779-4d1b-bbc5-076d9780a7a4 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:37.633519 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71034414-0779-4d1b-bbc5-076d9780a7a4 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:37.633955 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71034414-0779-4d1b-bbc5-076d9780a7a4 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:37.634657 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71034414-0779-4d1b-bbc5-076d9780a7a4 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:37.635109 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71034414-0779-4d1b-bbc5-076d9780a7a4 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:37.635882 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-71034414-0779-4d1b-bbc5-076d9780a7a4 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:37.647068 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-5d67194d-9dd0-42d1-9932-9c0230fd5444 req-5e7ce048-1168-443e-ae9f-4d2bc0b631f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fac5a97-f2b3-44fa-87cd-9069a2a67ae8", "name": "network-vif-plugged", "status": "completed", "tag": "7ec8a575-b9e0-49df-bbf0-6dd67916ba03"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:37.664901 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5d67194d-9dd0-42d1-9932-9c0230fd5444 req-5e7ce048-1168-443e-ae9f-4d2bc0b631f0 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:37.665394 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5d67194d-9dd0-42d1-9932-9c0230fd5444 req-5e7ce048-1168-443e-ae9f-4d2bc0b631f0 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:37.665818 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5d67194d-9dd0-42d1-9932-9c0230fd5444 req-5e7ce048-1168-443e-ae9f-4d2bc0b631f0 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:37.677724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-5d67194d-9dd0-42d1-9932-9c0230fd5444 req-5e7ce048-1168-443e-ae9f-4d2bc0b631f0 service nova] Creating event network-vif-plugged:7ec8a575-b9e0-49df-bbf0-6dd67916ba03 for instance 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 on hv-cinder-85638 Sep 13 06:50:37.682790 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-5d67194d-9dd0-42d1-9932-9c0230fd5444 req-5e7ce048-1168-443e-ae9f-4d2bc0b631f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039647 Sep 13 06:50:37.683695 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 572/1155] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:50:37.782076 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-71034414-0779-4d1b-bbc5-076d9780a7a4 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:37.790338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-71034414-0779-4d1b-bbc5-076d9780a7a4 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1314 microversion: 2.1 time: 0.168892 Sep 13 06:50:37.791167 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 584/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:37 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:37.812892 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:37.813585 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:37.821379 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:37.821853 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:37.822222 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:37.822924 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:37.823595 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:37.824116 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:37.840434 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:37.966112 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:37.974240 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:37.976381 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:37.977552 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-1022126e-d87a-4439-bed3-b723d2be3d38 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1724 microversion: 2.20 time: 0.169139 Sep 13 06:50:37.978104 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 573/1157] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:37 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:38.813968 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-98ab8e43-0a05-4f72-95b3-3aaf9dc8046c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:38.814538 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-98ab8e43-0a05-4f72-95b3-3aaf9dc8046c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:38.816440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:38.822344 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98ab8e43-0a05-4f72-95b3-3aaf9dc8046c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:38.822837 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98ab8e43-0a05-4f72-95b3-3aaf9dc8046c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:38.823275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98ab8e43-0a05-4f72-95b3-3aaf9dc8046c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:38.824188 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98ab8e43-0a05-4f72-95b3-3aaf9dc8046c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:38.824683 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98ab8e43-0a05-4f72-95b3-3aaf9dc8046c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:38.825115 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-98ab8e43-0a05-4f72-95b3-3aaf9dc8046c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:39.002964 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:39.003594 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:39.005425 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:39.006322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=6 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:39.012650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:39.013145 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:39.013588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:39.014311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:39.014774 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:39.015205 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:39.089745 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:39.098750 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:39.101018 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:39.102081 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2909ebc5-d084-4df5-a3f2-b44f90008d87 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1656 microversion: 2.20 time: 0.103112 Sep 13 06:50:39.102642 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 574/1158] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:38 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1656 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:50:39.159562 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-98ab8e43-0a05-4f72-95b3-3aaf9dc8046c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:39.170277 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-98ab8e43-0a05-4f72-95b3-3aaf9dc8046c tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1314 microversion: 2.1 time: 0.360275 Sep 13 06:50:39.170899 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 585/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:38 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:50:39.271418 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-8b73a7e9-5412-4ed4-9d3d-d5d6e58c23af req-a4a81a05-06b5-4c00-ad7b-9d260e7f9992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd984c2d-db41-44f6-9324-394602908a4b", "name": "network-vif-deleted", "tag": "85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:39.281163 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-8b73a7e9-5412-4ed4-9d3d-d5d6e58c23af req-a4a81a05-06b5-4c00-ad7b-9d260e7f9992 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:39.281806 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-8b73a7e9-5412-4ed4-9d3d-d5d6e58c23af req-a4a81a05-06b5-4c00-ad7b-9d260e7f9992 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:39.282049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-8b73a7e9-5412-4ed4-9d3d-d5d6e58c23af req-a4a81a05-06b5-4c00-ad7b-9d260e7f9992 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:39.295470 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-8b73a7e9-5412-4ed4-9d3d-d5d6e58c23af req-a4a81a05-06b5-4c00-ad7b-9d260e7f9992 service nova] Creating event network-vif-deleted:85fdc9d4-ef6a-4c4a-aa08-f3ff45dd233b for instance fd984c2d-db41-44f6-9324-394602908a4b on hv-cinder-85638 Sep 13 06:50:39.300290 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-8b73a7e9-5412-4ed4-9d3d-d5d6e58c23af req-a4a81a05-06b5-4c00-ad7b-9d260e7f9992 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032525 Sep 13 06:50:39.301049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 575/1160] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:50:40.127380 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:40.128000 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:40.135198 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:40.135714 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:40.136147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:40.136846 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:40.137299 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:40.137721 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:40.170095 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:40.170876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:40.171315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:40.172182 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.objects.instance [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lazy-loading 'fault' on Instance uuid fd984c2d-db41-44f6-9324-394602908a4b {{(pid=132399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:50:40.196150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-9e36289b-f1a7-4d75-9a99-2b6008d8151d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:40.197720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-9e36289b-f1a7-4d75-9a99-2b6008d8151d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:40.214317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e36289b-f1a7-4d75-9a99-2b6008d8151d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:40.215267 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e36289b-f1a7-4d75-9a99-2b6008d8151d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:40.215977 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e36289b-f1a7-4d75-9a99-2b6008d8151d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:40.217715 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e36289b-f1a7-4d75-9a99-2b6008d8151d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:40.218367 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e36289b-f1a7-4d75-9a99-2b6008d8151d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:40.218986 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-9e36289b-f1a7-4d75-9a99-2b6008d8151d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:40.240556 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:40.267081 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:40.272451 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:40.273805 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0e33cf8d-3c4e-4269-83df-628772d0629c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 200 len: 1371 microversion: 2.20 time: 0.150213 Sep 13 06:50:40.274380 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 586/1161] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:40 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:40.365034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-9e36289b-f1a7-4d75-9a99-2b6008d8151d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:40.373360 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-9e36289b-f1a7-4d75-9a99-2b6008d8151d tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1499 microversion: 2.1 time: 0.182914 Sep 13 06:50:40.373930 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 576/1162] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:40 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1499 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:40.917571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-05e5f3b0-aec7-4aff-8e50-b9e629fd6212 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:40.918069 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-05e5f3b0-aec7-4aff-8e50-b9e629fd6212 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:40.924367 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-05e5f3b0-aec7-4aff-8e50-b9e629fd6212 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:40.924855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-05e5f3b0-aec7-4aff-8e50-b9e629fd6212 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:40.925291 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-05e5f3b0-aec7-4aff-8e50-b9e629fd6212 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:40.925982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-05e5f3b0-aec7-4aff-8e50-b9e629fd6212 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:40.926458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-05e5f3b0-aec7-4aff-8e50-b9e629fd6212 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:40.926881 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-05e5f3b0-aec7-4aff-8e50-b9e629fd6212 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:40.953775 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-05e5f3b0-aec7-4aff-8e50-b9e629fd6212 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:50:41.029029 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-05e5f3b0-aec7-4aff-8e50-b9e629fd6212 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 204 len: 0 microversion: 2.1 time: 0.115847 Sep 13 06:50:41.029755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 587/1163] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:50:40 2022] DELETE /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 06:50:41.038648 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-cbed1ff6-07f3-4296-a1ee-72055c68caca tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:41.039505 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-cbed1ff6-07f3-4296-a1ee-72055c68caca tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:41.045578 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cbed1ff6-07f3-4296-a1ee-72055c68caca tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:41.046067 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cbed1ff6-07f3-4296-a1ee-72055c68caca tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:41.046501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cbed1ff6-07f3-4296-a1ee-72055c68caca tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:41.047191 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cbed1ff6-07f3-4296-a1ee-72055c68caca tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:41.047686 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cbed1ff6-07f3-4296-a1ee-72055c68caca tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:41.048115 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-cbed1ff6-07f3-4296-a1ee-72055c68caca tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:41.174809 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-cbed1ff6-07f3-4296-a1ee-72055c68caca tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:41.182413 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-cbed1ff6-07f3-4296-a1ee-72055c68caca tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1505 microversion: 2.1 time: 0.147715 Sep 13 06:50:41.182980 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 577/1164] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:41 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:41.300229 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:41.300922 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:41.307335 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:41.307840 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:41.308264 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:41.308936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:41.309383 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:41.309796 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:41.323376 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] HTTP exception thrown: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Request method failure captured: Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b HTTP/1.1 Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICcg-7wyunUQkmm3_CJp2JXyCKuf1A3xFLFOsQom-Gx5MQsTY3x6oomL2CEp52HUIRnUxzFlCIl3KE0jCxkkfeKlAZHu8VFy_P3OBSNng86Ts1ydgmnpN35oSWY_T6t1q-r2y5EKehsMdO_SP8FQzURyOoZyWJlgTTZ-hAQnIwRL5dQ Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:50:41.324969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a77de8686444581a7b5906cae6973f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 6b89305abaa14207b2840164c1a90e7b Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:50:41.326764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': 'fd984c2d-db41-44f6-9324-394602908a4b'} Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:50:41.327815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:50:41.329440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:41.330973 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Returning 404 to user: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:50:41.330973 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-45b2c750-febc-48bc-a24c-c2421acf6330 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 404 len: 111 microversion: 2.20 time: 0.030374 Sep 13 06:50:41.330973 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 588/1165] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:41 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 06:50:41.336329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-31fdd733-cdaa-44a2-97b3-a7c718d3f1d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '.version_select at 0x7fdc0d5b71f0>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:41.354024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-31fdd733-cdaa-44a2-97b3-a7c718d3f1d3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-992770201" status: 204 len: 0 microversion: 2.20 time: 0.022040 Sep 13 06:50:41.354582 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 578/1166] 10.222.0.17 () {60 vars in 1259 bytes} [Tue Sep 13 06:50:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-992770201 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 06:50:41.974585 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-882c0a6c-0c7c-401c-9d76-123216cf4d8e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Action: 'create', calling method: .version_select at 0x7fdc0d588820>, body: {"keypair": {"name": "tempest-keypair-697843720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDcdb8d1rtHsVzlQXI8LuM2bv3UcBDVyYDJeAxU1Drcbl7ZHhnfaZ2MOlp/3z2SjCKaTfCUWtAOdbOyCnrcMMx7zCqpZ3V5djH5BCQAkIlPUdHeiKfCiQybKDc/rVBcaA=="}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:41.990179 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-882c0a6c-0c7c-401c-9d76-123216cf4d8e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Getting quotas for project 1a77de8686444581a7b5906cae6973f5. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:50:41.994498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-882c0a6c-0c7c-401c-9d76-123216cf4d8e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Getting quotas for user 6b89305abaa14207b2840164c1a90e7b and project 1a77de8686444581a7b5906cae6973f5. Resources: {'key_pairs'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:50:42.016023 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-882c0a6c-0c7c-401c-9d76-123216cf4d8e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045436 Sep 13 06:50:42.016599 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 589/1167] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Sep 13 06:50:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 06:50:42.206002 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2800cfa1-0e82-4246-8dab-bdbe657e017e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:42.206719 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2800cfa1-0e82-4246-8dab-bdbe657e017e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:42.214481 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2800cfa1-0e82-4246-8dab-bdbe657e017e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:42.214984 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2800cfa1-0e82-4246-8dab-bdbe657e017e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:42.215461 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2800cfa1-0e82-4246-8dab-bdbe657e017e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:42.216180 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2800cfa1-0e82-4246-8dab-bdbe657e017e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:42.216807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2800cfa1-0e82-4246-8dab-bdbe657e017e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:42.217275 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2800cfa1-0e82-4246-8dab-bdbe657e017e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:42.375435 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2800cfa1-0e82-4246-8dab-bdbe657e017e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:42.383386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2800cfa1-0e82-4246-8dab-bdbe657e017e tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1505 microversion: 2.1 time: 0.181279 Sep 13 06:50:42.384393 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 579/1168] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:42 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:50:43.409259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-be343200-541d-4818-88dc-2b5d189603e7 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:43.409885 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-be343200-541d-4818-88dc-2b5d189603e7 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:43.418041 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be343200-541d-4818-88dc-2b5d189603e7 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:43.418611 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be343200-541d-4818-88dc-2b5d189603e7 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:43.419054 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be343200-541d-4818-88dc-2b5d189603e7 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:43.419993 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be343200-541d-4818-88dc-2b5d189603e7 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:43.420784 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be343200-541d-4818-88dc-2b5d189603e7 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:43.421264 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-be343200-541d-4818-88dc-2b5d189603e7 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:43.721109 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-b042edc5-a62a-46f4-a914-56a3e687aecc req-5438c54c-7ea4-46a4-abd0-782a877a593a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fac5a97-f2b3-44fa-87cd-9069a2a67ae8", "name": "network-vif-deleted", "tag": "7ec8a575-b9e0-49df-bbf0-6dd67916ba03"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:43.728614 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-be343200-541d-4818-88dc-2b5d189603e7 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2e5d889fd24bdfba78f1cbe7dd181d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da88371a3e1a436caea7f0e7a6117eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:43.739282 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-b042edc5-a62a-46f4-a914-56a3e687aecc req-5438c54c-7ea4-46a4-abd0-782a877a593a service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:43.740214 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-b042edc5-a62a-46f4-a914-56a3e687aecc req-5438c54c-7ea4-46a4-abd0-782a877a593a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:43.740628 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-b042edc5-a62a-46f4-a914-56a3e687aecc req-5438c54c-7ea4-46a4-abd0-782a877a593a service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:43.742692 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-be343200-541d-4818-88dc-2b5d189603e7 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 200 len: 1505 microversion: 2.1 time: 0.337188 Sep 13 06:50:43.743411 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 590/1169] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:43 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 06:50:43.748627 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1989462271", "imageRef": "d36863aa-e5b8-480b-b08e-3699206a6dbe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9076b3a-14f3-4a19-ae8d-eede5ca457d3"}], "security_groups": [{"name": "tempest-securitygroup--311100293"}], "key_name": "tempest-keypair-697843720", "user_data": "}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:43.768657 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-b042edc5-a62a-46f4-a914-56a3e687aecc req-5438c54c-7ea4-46a4-abd0-782a877a593a service nova] Creating event network-vif-deleted:7ec8a575-b9e0-49df-bbf0-6dd67916ba03 for instance 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 on hv-cinder-85638 Sep 13 06:50:43.774611 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-b042edc5-a62a-46f4-a914-56a3e687aecc req-5438c54c-7ea4-46a4-abd0-782a877a593a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064486 Sep 13 06:50:43.775758 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 580/1170] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:50:43.868380 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.network.neutron [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] validate_networks() for [('f9076b3a-14f3-4a19-ae8d-eede5ca457d3', None, None, None, None, None)] {{(pid=132399) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 06:50:44.240417 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Flavor limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 06:50:44.240952 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Image limits 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 06:50:44.241457 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Flavor pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 06:50:44.241873 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Image pref 0:0:0 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 06:50:44.242291 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.virt.hardware [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 06:50:44.250862 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:44.251493 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:44.251934 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:44.252665 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:44.253120 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:44.253544 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:44.270610 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Getting quotas for project 1a77de8686444581a7b5906cae6973f5. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 06:50:44.275389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.quota [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Getting quotas for user 6b89305abaa14207b2840164c1a90e7b and project 1a77de8686444581a7b5906cae6973f5. Resources: {'instances', 'ram', 'cores'} {{(pid=132399) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 06:50:44.286575 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Going to run 1 instances... {{(pid=132399) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 06:50:44.289284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d36863aa-e5b8-480b-b08e-3699206a6dbe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 06:50:44.340482 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-493ec07c-71cf-48cd-b7a7-f9a04c4cd860 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.595826 Sep 13 06:50:44.348140 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 591/1171] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Sep 13 06:50:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 06:50:44.354691 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0a766831-5ba8-4094-a370-241b13924fab tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:44.355425 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0a766831-5ba8-4094-a370-241b13924fab tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:44.433598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0a766831-5ba8-4094-a370-241b13924fab tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:44.444140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0a766831-5ba8-4094-a370-241b13924fab tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:44.446658 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0a766831-5ba8-4094-a370-241b13924fab tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:44.449338 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0a766831-5ba8-4094-a370-241b13924fab tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1281 microversion: 2.20 time: 0.099452 Sep 13 06:50:44.450467 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 581/1172] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:44 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1281 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:44.766186 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:44.766800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] [instance: 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:44.774079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:44.774626 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:44.775067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:44.775871 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:44.776362 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:44.776933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:44.790715 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] HTTP exception thrown: Instance 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 could not be found. Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Request method failure captured: Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 HTTP/1.1 Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICggcdCrVVpfirHpRtXuWa_9tFBOaUpimJzFRNMd9PqFb1t94rdflvN0EYjoCk-GpnwOF5hfeOd6pCcpioZxhS8TWJR1z4_UQNrbhgyMnZzqgyGwl-OFE9_o5Ra_HlzhzK1hEmx0q1nHGVn6swDcmbxmt70g8Y2wTB9lMwlcB655aws Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: da88371a3e1a436caea7f0e7a6117eb2 Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-VolumesActionsTest-2044278456 Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:50:44.792548 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/da88371a3e1a436caea7f0e7a6117eb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/da88371a3e1a436caea7f0e7a6117eb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/da88371a3e1a436caea7f0e7a6117eb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_da88371a3e1a436caea7f0e7a6117eb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-VolumesActionsTest-2044278456 Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: da88371a3e1a436caea7f0e7a6117eb2 Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-VolumesActionsTest-2044278456 Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-VolumesActionsTest-2044278456-project Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 5f2e5d889fd24bdfba78f1cbe7dd181d Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-VolumesActionsTest-2044278456-project Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 could not be found. Sep 13 06:50:44.794220 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '0fac5a97-f2b3-44fa-87cd-9069a2a67ae8'} Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 could not be found. Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:50:44.795143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 could not be found. Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 could not be found. Sep 13 06:50:44.796573 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:50:44.798007 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] Returning 404 to user: Instance 0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:50:44.798007 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-bfcac38d-5aa2-4a8a-88b2-aed8936ed444 tempest-VolumesActionsTest-2044278456 tempest-VolumesActionsTest-2044278456-project] 10.222.0.17 "GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8" status: 404 len: 111 microversion: 2.1 time: 0.032409 Sep 13 06:50:44.798385 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 592/1173] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:50:44 2022] GET /compute/v2.1/servers/0fac5a97-f2b3-44fa-87cd-9069a2a67ae8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:50:45.480645 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:45.481403 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:45.488354 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:45.488768 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:45.489204 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:45.490215 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:45.490850 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:45.491966 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:45.566181 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:45.586211 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:45.589851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:45.591245 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-69e07902-bd83-4d7e-b49c-95c7dbcddcf4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1333 microversion: 2.20 time: 0.114544 Sep 13 06:50:45.592304 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 582/1174] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:45 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1333 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:46.617711 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:46.618269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:46.624771 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:46.625244 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:46.625763 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:46.626550 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:46.626996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:46.627447 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:46.757338 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:46.769202 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:46.770822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:46.771952 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-3c757ae8-0384-4511-9483-4166f4ccf3c2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.158697 Sep 13 06:50:46.772504 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 593/1175] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:46 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:47.797289 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:47.797900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:47.804337 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:47.804822 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:47.805261 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:47.805958 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:47.806418 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:47.806846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:47.937572 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:47.946034 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:47.947503 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:47.948614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-68384f19-c09d-49d4-a095-6915d10b3296 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.155232 Sep 13 06:50:47.949170 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 583/1176] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:47 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:48.725707 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-7d693c35-4bb5-4514-b166-c2a42e7f02ad req-79fef06d-dc81-44fa-ab32-304879774bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a5aa36-85de-4d99-8755-d58f9136520d", "tag": "50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:48.735964 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-7d693c35-4bb5-4514-b166-c2a42e7f02ad req-79fef06d-dc81-44fa-ab32-304879774bec service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:48.736471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-7d693c35-4bb5-4514-b166-c2a42e7f02ad req-79fef06d-dc81-44fa-ab32-304879774bec service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:48.736895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-7d693c35-4bb5-4514-b166-c2a42e7f02ad req-79fef06d-dc81-44fa-ab32-304879774bec service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:48.748465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-7d693c35-4bb5-4514-b166-c2a42e7f02ad req-79fef06d-dc81-44fa-ab32-304879774bec service nova] Creating event network-changed:50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4 for instance 04a5aa36-85de-4d99-8755-d58f9136520d on hv-cinder-85638 Sep 13 06:50:48.753228 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-7d693c35-4bb5-4514-b166-c2a42e7f02ad req-79fef06d-dc81-44fa-ab32-304879774bec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031508 Sep 13 06:50:48.753963 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 594/1177] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:50:48.973717 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:48.974280 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:48.981241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:48.981722 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:48.982158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:48.982843 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:48.983294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:48.983742 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:49.108024 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:49.115985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:49.118071 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:49.119170 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-5b949a17-0024-4334-a352-9e879df21d74 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.149466 Sep 13 06:50:49.119757 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 584/1178] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:48 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:50.144825 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:50.145653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:50.151648 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:50.152148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:50.152564 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:50.153252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:50.153706 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:50.154129 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:50.327349 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:50.335398 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:50.336852 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:50.337936 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-553a1455-07f0-4278-81aa-a03930fc2250 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.197914 Sep 13 06:50:50.338496 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 595/1179] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:50 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:51.364617 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:51.366001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:51.372933 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:51.373612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:51.374246 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:51.375118 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:51.375896 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:51.376491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:51.516852 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:51.525604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:51.527125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:51.528612 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-edcf3566-4922-41cc-a96f-9e3166d52b28 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.167913 Sep 13 06:50:51.529362 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 585/1180] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:51 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:52.559189 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:52.561221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:52.572150 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:52.572880 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:52.573724 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:52.574808 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:52.575266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:52.575718 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:52.832280 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:52.844460 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:52.846315 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:52.847819 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-83795ee5-57be-4edd-af1d-c060748ccb7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.295181 Sep 13 06:50:52.859453 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 596/1181] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:52 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:53.874189 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:53.874804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:53.881476 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:53.881967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:53.882446 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:53.883786 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:53.884262 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:53.884695 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:54.028967 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:54.037245 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:54.038851 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:54.040059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2188bb44-dcb4-4c2d-b08c-8b8a28983ba2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.169813 Sep 13 06:50:54.040985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 586/1182] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:53 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:55.066508 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:55.067135 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:55.069468 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=2 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:55.070622 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell0:SELECT=10 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:55.076631 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:55.077114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:55.077546 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:55.078242 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:55.078697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:55.079125 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:55.224782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:55.233360 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:55.234788 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:55.235921 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-280ed143-0770-4d59-888c-10f560c0d202 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.173500 Sep 13 06:50:55.236782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 597/1183] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:55 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:56.263753 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:56.264562 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:56.270987 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell0:SELECT=2 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:56.276023 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:56.276841 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:56.277394 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:56.278202 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:56.278955 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:56.279487 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:56.433069 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:56.441871 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:56.443842 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:56.446951 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-09cf548d-0418-4857-b577-0cf9b721495a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.189025 Sep 13 06:50:56.447836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 587/1184] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:56 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:57.474416 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:57.475020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:57.486210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:57.488609 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:57.489539 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:57.490749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:57.491569 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:57.493165 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:57.519416 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:57.673996 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:57.683309 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:57.687184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:57.687184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-fd4a9f7b-1a05-42ae-86a3-e0c211910b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.216364 Sep 13 06:50:57.687184 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 598/1185] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:57 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:57.715143 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-5ad92158-1baa-42c5-a9c4-6dab44191393 req-73bc1e8e-99e7-459f-ac2e-ce77d0256a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a5aa36-85de-4d99-8755-d58f9136520d", "name": "network-vif-plugged", "status": "completed", "tag": "50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:50:57.729824 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5ad92158-1baa-42c5-a9c4-6dab44191393 req-73bc1e8e-99e7-459f-ac2e-ce77d0256a04 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:57.730390 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5ad92158-1baa-42c5-a9c4-6dab44191393 req-73bc1e8e-99e7-459f-ac2e-ce77d0256a04 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:57.730946 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5ad92158-1baa-42c5-a9c4-6dab44191393 req-73bc1e8e-99e7-459f-ac2e-ce77d0256a04 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:57.754744 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-5ad92158-1baa-42c5-a9c4-6dab44191393 req-73bc1e8e-99e7-459f-ac2e-ce77d0256a04 service nova] Creating event network-vif-plugged:50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4 for instance 04a5aa36-85de-4d99-8755-d58f9136520d on hv-cinder-85638 Sep 13 06:50:57.760632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-5ad92158-1baa-42c5-a9c4-6dab44191393 req-73bc1e8e-99e7-459f-ac2e-ce77d0256a04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049142 Sep 13 06:50:57.761777 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 588/1186] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:50:58.712016 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:58.713324 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:58.720312 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:58.720817 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:58.721276 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:58.721973 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:58.722431 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:58.722863 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:58.864094 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:58.885295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:58.890643 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:50:58.892002 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7e5871d0-d357-48c6-98c9-11bfe6d38138 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.183879 Sep 13 06:50:58.892749 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 599/1187] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:58 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:50:59.919954 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:50:59.921222 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:50:59.932196 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:59.932868 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:59.933588 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:50:59.934496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:50:59.935118 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:50:59.935747 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:51:00.149159 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:51:00.157959 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:51:00.159598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:51:00.160726 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-3329f42d-2ef3-4efe-a167-5b7e329eaa2c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1406 microversion: 2.20 time: 0.245676 Sep 13 06:51:00.163136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 589/1188] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:50:59 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:51:01.188498 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:51:01.189719 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:51:01.196351 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:51:01.197054 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:51:01.197769 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:51:01.198685 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:51:01.199206 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:51:01.199653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:51:01.342234 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:51:01.352812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:51:01.355008 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:51:01.356567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f0ec983b-dec3-474b-80d4-a36c1fc9800a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1598 microversion: 2.20 time: 0.171943 Sep 13 06:51:01.357385 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 600/1189] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:51:01 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:51:01.385856 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-781abad5-cb61-400c-9aa8-5f4f75a03d2e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:51:01.386650 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-781abad5-cb61-400c-9aa8-5f4f75a03d2e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:51:01.393311 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-781abad5-cb61-400c-9aa8-5f4f75a03d2e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:51:01.394294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-781abad5-cb61-400c-9aa8-5f4f75a03d2e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:51:01.394904 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-781abad5-cb61-400c-9aa8-5f4f75a03d2e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:51:01.396294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-781abad5-cb61-400c-9aa8-5f4f75a03d2e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:51:01.396785 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-781abad5-cb61-400c-9aa8-5f4f75a03d2e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:51:01.397212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-781abad5-cb61-400c-9aa8-5f4f75a03d2e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:51:01.487476 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-781abad5-cb61-400c-9aa8-5f4f75a03d2e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105952 Sep 13 06:51:01.488835 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 590/1190] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Sep 13 06:51:01 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:51:02.566039 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-76992373-135f-4855-b38a-a3f46fed7c64 req-e31a92b8-9edc-4274-99d2-eeb27ac56e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a5aa36-85de-4d99-8755-d58f9136520d", "tag": "50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:51:02.577471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-76992373-135f-4855-b38a-a3f46fed7c64 req-e31a92b8-9edc-4274-99d2-eeb27ac56e81 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:51:02.577973 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-76992373-135f-4855-b38a-a3f46fed7c64 req-e31a92b8-9edc-4274-99d2-eeb27ac56e81 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:51:02.578450 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-76992373-135f-4855-b38a-a3f46fed7c64 req-e31a92b8-9edc-4274-99d2-eeb27ac56e81 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:51:02.594803 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-76992373-135f-4855-b38a-a3f46fed7c64 req-e31a92b8-9edc-4274-99d2-eeb27ac56e81 service nova] Creating event network-changed:50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4 for instance 04a5aa36-85de-4d99-8755-d58f9136520d on hv-cinder-85638 Sep 13 06:51:02.603162 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-76992373-135f-4855-b38a-a3f46fed7c64 req-e31a92b8-9edc-4274-99d2-eeb27ac56e81 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040633 Sep 13 06:51:02.604133 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 601/1191] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:52:03.755116 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:03.756572 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=79 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:03.758822 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:03.760401 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=17 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:03.766079 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-955f3e6c-2c9f-4b3b-b1ce-6b8ce77fb3bf req-b1456b36-0957-4a8e-be1e-254ec6190341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd6a470-5bbf-4d29-b5e2-860f8f7c551b", "tag": "35c33167-d432-4f8a-b748-145b6562d972"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:52:03.770598 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8ac9d67f-b121-4d60-993e-069e603b81c5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:03.770781 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8ac9d67f-b121-4d60-993e-069e603b81c5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:03.782985 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac9d67f-b121-4d60-993e-069e603b81c5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:03.783944 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac9d67f-b121-4d60-993e-069e603b81c5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:03.784401 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac9d67f-b121-4d60-993e-069e603b81c5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:03.785351 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac9d67f-b121-4d60-993e-069e603b81c5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:03.785847 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac9d67f-b121-4d60-993e-069e603b81c5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:03.786675 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8ac9d67f-b121-4d60-993e-069e603b81c5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:03.789331 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-955f3e6c-2c9f-4b3b-b1ce-6b8ce77fb3bf req-b1456b36-0957-4a8e-be1e-254ec6190341 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:03.790124 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-955f3e6c-2c9f-4b3b-b1ce-6b8ce77fb3bf req-b1456b36-0957-4a8e-be1e-254ec6190341 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:03.790827 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-955f3e6c-2c9f-4b3b-b1ce-6b8ce77fb3bf req-b1456b36-0957-4a8e-be1e-254ec6190341 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:03.810357 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.compute.server_external_events [req-955f3e6c-2c9f-4b3b-b1ce-6b8ce77fb3bf req-b1456b36-0957-4a8e-be1e-254ec6190341 service nova] Creating event network-changed:35c33167-d432-4f8a-b748-145b6562d972 for instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b on hv-cinder-85638 Sep 13 06:52:03.817356 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-955f3e6c-2c9f-4b3b-b1ce-6b8ce77fb3bf req-b1456b36-0957-4a8e-be1e-254ec6190341 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061349 Sep 13 06:52:03.818860 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 602/1192] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:52:03.822595 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8ac9d67f-b121-4d60-993e-069e603b81c5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Going to try to terminate instance {{(pid=132398) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:52:03.919564 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8ac9d67f-b121-4d60-993e-069e603b81c5 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 204 len: 0 microversion: 2.1 time: 0.166824 Sep 13 06:52:03.920153 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 591/1193] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Sep 13 06:52:03 2022] DELETE /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:52:03.930019 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-340297ee-0aea-4179-bb0a-ec1ca507f11b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:03.931067 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-340297ee-0aea-4179-bb0a-ec1ca507f11b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:03.938099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-340297ee-0aea-4179-bb0a-ec1ca507f11b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:03.938660 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-340297ee-0aea-4179-bb0a-ec1ca507f11b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:03.939160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-340297ee-0aea-4179-bb0a-ec1ca507f11b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:03.940010 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-340297ee-0aea-4179-bb0a-ec1ca507f11b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:03.940357 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-340297ee-0aea-4179-bb0a-ec1ca507f11b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:03.941007 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-340297ee-0aea-4179-bb0a-ec1ca507f11b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:04.079243 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-340297ee-0aea-4179-bb0a-ec1ca507f11b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:04.087702 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-340297ee-0aea-4179-bb0a-ec1ca507f11b tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.162733 Sep 13 06:52:04.088274 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 603/1194] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:52:03 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:52:05.111285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-0bf33e3a-2bb4-4de5-8246-f179427048b3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:05.111937 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-0bf33e3a-2bb4-4de5-8246-f179427048b3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:05.118302 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bf33e3a-2bb4-4de5-8246-f179427048b3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:05.118789 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bf33e3a-2bb4-4de5-8246-f179427048b3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:05.119226 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bf33e3a-2bb4-4de5-8246-f179427048b3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:05.119957 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bf33e3a-2bb4-4de5-8246-f179427048b3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:05.120416 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bf33e3a-2bb4-4de5-8246-f179427048b3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:05.120844 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-0bf33e3a-2bb4-4de5-8246-f179427048b3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:05.249456 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-0bf33e3a-2bb4-4de5-8246-f179427048b3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:05.257174 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-0bf33e3a-2bb4-4de5-8246-f179427048b3 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1568 microversion: 2.1 time: 0.150185 Sep 13 06:52:05.257748 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 592/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:52:05 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:52:06.281387 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-b8c3c36e-a944-4840-a416-04508f917450 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:06.282131 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-b8c3c36e-a944-4840-a416-04508f917450 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:06.289185 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b8c3c36e-a944-4840-a416-04508f917450 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:06.289667 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b8c3c36e-a944-4840-a416-04508f917450 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:06.290099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b8c3c36e-a944-4840-a416-04508f917450 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:06.291026 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b8c3c36e-a944-4840-a416-04508f917450 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:06.291512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b8c3c36e-a944-4840-a416-04508f917450 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:06.291965 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-b8c3c36e-a944-4840-a416-04508f917450 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:06.308546 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-5fd9af9b-574d-4970-8d50-3cd05b52fda4 req-b1ea4b11-5e68-47d3-849d-c5aedbf21a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd6a470-5bbf-4d29-b5e2-860f8f7c551b", "name": "network-vif-deleted", "tag": "35c33167-d432-4f8a-b748-145b6562d972"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:52:06.320338 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5fd9af9b-574d-4970-8d50-3cd05b52fda4 req-b1ea4b11-5e68-47d3-849d-c5aedbf21a83 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:06.320757 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5fd9af9b-574d-4970-8d50-3cd05b52fda4 req-b1ea4b11-5e68-47d3-849d-c5aedbf21a83 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:06.321186 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-5fd9af9b-574d-4970-8d50-3cd05b52fda4 req-b1ea4b11-5e68-47d3-849d-c5aedbf21a83 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:06.333759 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-5fd9af9b-574d-4970-8d50-3cd05b52fda4 req-b1ea4b11-5e68-47d3-849d-c5aedbf21a83 service nova] Creating event network-vif-deleted:35c33167-d432-4f8a-b748-145b6562d972 for instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b on hv-cinder-85638 Sep 13 06:52:06.339488 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-5fd9af9b-574d-4970-8d50-3cd05b52fda4 req-b1ea4b11-5e68-47d3-849d-c5aedbf21a83 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Sep 13 06:52:06.340534 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 593/1196] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:52:06.359680 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-b8c3c36e-a944-4840-a416-04508f917450 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2742fc15584c4f0e87b8c30614efa877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456f4a7236834a4985af1518a6884a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:06.368356 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-b8c3c36e-a944-4840-a416-04508f917450 tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 200 len: 1383 microversion: 2.1 time: 0.090847 Sep 13 06:52:06.368926 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 604/1197] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:52:06 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 1383 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:52:07.393512 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:07.394125 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] [instance: dfd6a470-5bbf-4d29-b5e2-860f8f7c551b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:07.400592 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:07.401075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:07.401507 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:07.402194 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:07.402645 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:07.403064 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:07.416233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] HTTP exception thrown: Instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b could not be found. Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Request method failure captured: Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b HTTP/1.1 Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICcps8tYaIBYinQ2qPEdTeUe2yrXm2DZat5oBDtYblqt_Tc9d2qnzXt_sp4NE3jQMEFEONGSr0HpZqfpHdBzAJCgWKYd-0tlCqOBiB2GMgu7NrwIXKHzWt7jvGgItQXZftvi6JkMpnmeaHFduWV0nP8dYbiV3kTRCZteoQjeHAYcKqc Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 456f4a7236834a4985af1518a6884a5a Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-TestShelveInstance-970934319 Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:52:07.418124 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/456f4a7236834a4985af1518a6884a5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/456f4a7236834a4985af1518a6884a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/456f4a7236834a4985af1518a6884a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_456f4a7236834a4985af1518a6884a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-TestShelveInstance-970934319 Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 456f4a7236834a4985af1518a6884a5a Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-TestShelveInstance-970934319 Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-TestShelveInstance-970934319-project Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 2742fc15584c4f0e87b8c30614efa877 Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-TestShelveInstance-970934319-project Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b could not be found. Sep 13 06:52:07.419999 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'dfd6a470-5bbf-4d29-b5e2-860f8f7c551b'} Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b could not be found. Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:52:07.421157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b could not be found. Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b could not be found. Sep 13 06:52:07.422831 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:52:07.424498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Returning 404 to user: Instance dfd6a470-5bbf-4d29-b5e2-860f8f7c551b could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:52:07.424498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-05c6e207-becc-47ed-8f2b-bee98382a2fc tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b" status: 404 len: 111 microversion: 2.1 time: 0.030962 Sep 13 06:52:07.424498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 594/1198] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Sep 13 06:52:07 2022] GET /compute/v2.1/servers/dfd6a470-5bbf-4d29-b5e2-860f8f7c551b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 06:52:07.582488 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-2dd8454e-57bc-43fc-9af5-1dcc5e6025bf tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] Calling method '.version_select at 0x7fdc0d54ff70>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:07.604283 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-2dd8454e-57bc-43fc-9af5-1dcc5e6025bf tempest-TestShelveInstance-970934319 tempest-TestShelveInstance-970934319-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1019875465" status: 202 len: 0 microversion: 2.1 time: 0.025511 Sep 13 06:52:07.604883 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 605/1199] 10.222.0.17 () {58 vars in 1254 bytes} [Tue Sep 13 06:52:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1019875465 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 06:52:18.080609 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d341b0fe-c986-4b79-bd40-e5b82031d75b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:18.081099 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d341b0fe-c986-4b79-bd40-e5b82031d75b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:18.083329 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:18.084140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:18.091870 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d341b0fe-c986-4b79-bd40-e5b82031d75b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:18.092359 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d341b0fe-c986-4b79-bd40-e5b82031d75b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:18.092797 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d341b0fe-c986-4b79-bd40-e5b82031d75b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:18.093495 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d341b0fe-c986-4b79-bd40-e5b82031d75b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:18.093953 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d341b0fe-c986-4b79-bd40-e5b82031d75b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:18.094380 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d341b0fe-c986-4b79-bd40-e5b82031d75b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:18.118397 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d341b0fe-c986-4b79-bd40-e5b82031d75b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/ips" status: 200 len: 152 microversion: 2.20 time: 0.041755 Sep 13 06:52:18.118963 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 595/1200] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Sep 13 06:52:18 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:52:19.871748 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=14 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:19.872545 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:19.877323 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-df6c2bec-9619-449e-a85f-1d026e88ac72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:52:19.877855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-df6c2bec-9619-449e-a85f-1d026e88ac72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:19.885812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df6c2bec-9619-449e-a85f-1d026e88ac72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:19.886297 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df6c2bec-9619-449e-a85f-1d026e88ac72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:19.886732 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df6c2bec-9619-449e-a85f-1d026e88ac72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:19.887466 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df6c2bec-9619-449e-a85f-1d026e88ac72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:19.887925 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df6c2bec-9619-449e-a85f-1d026e88ac72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:19.888350 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-df6c2bec-9619-449e-a85f-1d026e88ac72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:19.911120 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.objects.instance [None req-df6c2bec-9619-449e-a85f-1d026e88ac72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lazy-loading 'flavor' on Instance uuid 04a5aa36-85de-4d99-8755-d58f9136520d {{(pid=132399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 06:52:20.094767 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-df6c2bec-9619-449e-a85f-1d026e88ac72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "POST /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/action" status: 202 len: 0 microversion: 2.20 time: 0.224164 Sep 13 06:52:20.095382 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 606/1201] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Sep 13 06:52:19 2022] POST /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:52:20.104769 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:20.105374 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:20.112114 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:20.112626 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:20.113116 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:20.113891 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:20.114451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:20.114936 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:20.248946 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:20.256922 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:20.258432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:20.259616 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-dcbad5b1-445c-4c06-950a-c1daced7f32a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.160071 Sep 13 06:52:20.260179 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 596/1202] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:20 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:21.286623 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:21.287334 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:21.294778 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:21.295259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:21.295720 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:21.296408 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:21.296868 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:21.297294 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:21.428611 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:21.437182 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:21.438625 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:21.439800 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-17bd9a24-15f1-41ac-a75a-bfcf8a21a596 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.157945 Sep 13 06:52:21.440354 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 607/1203] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:21 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:22.465921 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:22.466553 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:22.472907 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:22.473386 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:22.473818 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:22.474498 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:22.474949 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:22.475396 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:22.602941 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:22.610894 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:22.612346 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:22.613496 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7decda97-4f4a-44c7-be0b-668a3237ec07 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.151477 Sep 13 06:52:22.614052 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 597/1204] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:22 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:23.638431 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:23.639036 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:23.645465 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:23.645944 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:23.646375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:23.647062 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:23.648209 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:23.648634 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:23.773862 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:23.781844 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:23.783284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:23.784463 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ee915ccd-7cc2-41b9-8dbc-6d5876f8f791 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.149927 Sep 13 06:52:23.785017 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 608/1205] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:23 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:24.810408 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:24.811128 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:24.817499 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:24.817972 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:24.818400 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:24.819085 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:24.819576 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:24.820001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:24.947829 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:24.955744 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:24.957180 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:24.958333 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e02b9f87-1180-4add-acf8-4a5f79909eac tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.151839 Sep 13 06:52:24.958875 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 598/1206] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:24 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:25.984844 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:25.985543 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:25.992029 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:25.992514 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:25.992951 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:25.993651 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:25.994108 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:25.994533 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:26.139930 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:26.151020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:26.151020 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:26.151951 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-951668a6-0cc7-4c99-83fa-30301fe87726 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.171397 Sep 13 06:52:26.152503 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 609/1207] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:25 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:52:27.181811 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:27.182401 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:27.188780 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:27.189258 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:27.189690 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:27.190378 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:27.190828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:27.191251 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:27.321378 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:27.329343 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:27.330782 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:27.331971 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-252f409e-05fb-499a-86cd-b7fe65dcaea2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.154190 Sep 13 06:52:27.332540 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 599/1208] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:27 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:28.358440 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:28.359027 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:28.365335 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:28.365848 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:28.366475 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:28.367160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:28.367633 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:28.368052 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:28.495614 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:28.503628 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:28.505053 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:28.506195 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5fbfa64f-2fba-4a94-82ff-40e609e6a5e3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.152281 Sep 13 06:52:28.506751 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 610/1209] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:28 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:29.531772 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:29.532384 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:29.538800 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:29.539269 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:29.539732 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:29.540424 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:29.540882 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:29.541307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:29.667900 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:29.675803 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:29.677255 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:29.678419 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-204167f0-4aa0-463e-b9d1-f5710d56dab1 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.150811 Sep 13 06:52:29.679483 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 600/1210] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:29 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:30.704972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:30.705578 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:30.712565 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:30.713045 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:30.713480 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:30.714194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:30.714652 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:30.715073 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:30.845571 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:30.853551 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:30.855048 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:30.856225 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7e425713-66b4-4289-86f8-363fa7adeac5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.155188 Sep 13 06:52:30.856777 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 611/1211] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:30 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:31.881317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:31.881860 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:31.888295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:31.888780 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:31.889217 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:31.889909 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:31.890367 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:31.890794 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:32.019951 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:32.028531 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:32.030015 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:32.031215 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-511de39a-4c82-425c-a210-0f177cf3898e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1744 microversion: 2.20 time: 0.153862 Sep 13 06:52:32.031800 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 601/1212] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:31 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:33.058655 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:33.059256 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:33.065684 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:33.066160 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:33.066584 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:33.067266 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:33.067738 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:33.068154 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:33.206298 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:33.215010 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:33.216477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:33.217621 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-485fe664-8ebc-44c9-a9e3-4b2d1ad0403d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1744 microversion: 2.20 time: 0.162858 Sep 13 06:52:33.218172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 612/1213] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:33 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:34.243032 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:34.243677 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:34.250758 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:34.251307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:34.251714 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:34.252404 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:34.252847 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:34.253262 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:34.382899 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:34.391115 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:34.392597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:34.394219 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fac97050-3c37-467a-9488-308574b46524 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1744 microversion: 2.20 time: 0.155544 Sep 13 06:52:34.394778 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 602/1214] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:34 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:35.420451 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:35.421054 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:35.427434 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:35.427876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:35.429014 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:35.429755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:35.430208 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:35.430635 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:35.557041 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:35.565057 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:35.566492 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:35.567668 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-380bb3e7-588c-4acb-8a49-e20edda215a3 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1744 microversion: 2.20 time: 0.151463 Sep 13 06:52:35.568234 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 613/1215] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:35 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:36.081046 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-e580760e-7e8d-4add-b4f4-1767bce3e5ce req-3127969d-edae-48d9-9997-fe9228adf9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a5aa36-85de-4d99-8755-d58f9136520d", "name": "network-vif-plugged", "status": "completed", "tag": "50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:52:36.091604 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-e580760e-7e8d-4add-b4f4-1767bce3e5ce req-3127969d-edae-48d9-9997-fe9228adf9c7 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:36.092081 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-e580760e-7e8d-4add-b4f4-1767bce3e5ce req-3127969d-edae-48d9-9997-fe9228adf9c7 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:36.092520 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-e580760e-7e8d-4add-b4f4-1767bce3e5ce req-3127969d-edae-48d9-9997-fe9228adf9c7 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:36.104543 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-e580760e-7e8d-4add-b4f4-1767bce3e5ce req-3127969d-edae-48d9-9997-fe9228adf9c7 service nova] Creating event network-vif-plugged:50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4 for instance 04a5aa36-85de-4d99-8755-d58f9136520d on hv-cinder-85638 Sep 13 06:52:36.109518 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-e580760e-7e8d-4add-b4f4-1767bce3e5ce req-3127969d-edae-48d9-9997-fe9228adf9c7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032130 Sep 13 06:52:36.110317 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 603/1216] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:52:36.592663 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:36.593269 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:36.599586 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:36.600062 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:36.600513 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:36.601196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:36.601641 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:36.602058 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:36.730159 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:36.738110 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:36.739567 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:36.740717 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7845a59a-0300-43b9-a561-9193294da5a0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1744 microversion: 2.20 time: 0.151923 Sep 13 06:52:36.741783 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 614/1217] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:36 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:37.768423 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:37.769140 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:37.775963 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:37.776443 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:37.776878 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:37.777561 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:37.778007 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:37.778423 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:37.924601 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:37.933774 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:37.935689 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:37.938697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e0dcbdec-0eac-4efc-8801-e56c9a7f3b9b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1739 microversion: 2.20 time: 0.174215 Sep 13 06:52:37.947938 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 604/1218] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:37 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:38.976379 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:38.977190 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:38.983632 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:38.984227 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:38.984763 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:38.985560 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:38.986137 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:38.986665 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:39.124237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:39.133836 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:39.136054 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:39.137487 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-a57fe2ac-908b-4202-83ab-dce9ba8c9247 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1739 microversion: 2.20 time: 0.165662 Sep 13 06:52:39.138425 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 615/1219] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:38 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:40.175531 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:40.176614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:40.183458 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:40.183961 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:40.184395 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:40.185126 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:40.185587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:40.186020 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:40.330297 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:40.340054 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:40.341901 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:40.343307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2b26472c-303f-495c-8fe5-e020072cbb1c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1739 microversion: 2.20 time: 0.172776 Sep 13 06:52:40.344105 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 605/1220] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:40 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:41.382221 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:41.382934 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:41.390876 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:41.391322 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:41.391803 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:41.392697 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:41.393145 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:41.393799 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:41.549960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:41.558864 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:41.560442 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:41.561880 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-0bc92fec-cfa8-4d3b-9c25-ee0b85b2fe26 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1739 microversion: 2.20 time: 0.184643 Sep 13 06:52:41.562925 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 616/1221] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:41 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:42.594895 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:42.596591 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:42.605431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:42.606274 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:42.606806 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:42.607746 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:42.608293 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:42.608724 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:42.748430 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:42.756751 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:42.758285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:42.759481 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-257be076-ef5a-4950-9db8-890ef12f55f5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1739 microversion: 2.20 time: 0.168492 Sep 13 06:52:42.760248 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 606/1222] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:42 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:43.785546 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:43.787114 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:43.794987 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:43.795960 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:43.796870 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:43.797812 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:43.798327 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:43.798819 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:43.941260 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:43.949889 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:43.951333 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:43.952537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-237d3b9b-d7ad-442d-8da0-a79cd5dd9090 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1739 microversion: 2.20 time: 0.171283 Sep 13 06:52:43.953284 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 617/1223] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:43 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:44.978740 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:44.979597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:44.986313 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:44.986790 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:44.987217 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:44.987937 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:44.988389 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:44.988811 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:45.129156 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:45.137623 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:45.139068 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:45.140330 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-efe5aaa4-9f93-4cab-9ab8-c9e84c03ad31 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1739 microversion: 2.20 time: 0.166157 Sep 13 06:52:45.141069 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 607/1224] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:44 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:46.166728 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:46.167704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:46.174255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:46.174765 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:46.175194 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:46.175916 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:46.176367 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:46.176820 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:46.353434 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:46.371562 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:46.382210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:46.383437 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-f9100be5-eec9-4c50-a0f5-85791bb3b0c7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1739 microversion: 2.20 time: 0.220691 Sep 13 06:52:46.396341 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 618/1225] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:46 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:47.409704 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:47.410298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:47.416677 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:47.417161 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:47.417852 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:47.418543 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:47.419185 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:47.419633 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:47.557770 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:47.565850 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:47.567294 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:47.568485 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-35c8c003-0c43-4b14-9693-620bb2c6d05e tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1739 microversion: 2.20 time: 0.162705 Sep 13 06:52:47.569934 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 608/1226] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:47 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:48.597678 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:48.598259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:48.605427 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:48.605905 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:48.606331 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:48.607021 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:48.607494 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:48.607920 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:48.739984 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:48.748512 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:48.749950 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:48.751099 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1ce5a53e-49ec-4538-8bca-2a95fdca29a9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1721 microversion: 2.20 time: 0.157339 Sep 13 06:52:48.751690 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 619/1227] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:48 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:49.777285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:49.777829 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:49.780295 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=29 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:49.785327 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:49.785806 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:49.786237 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:49.786915 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:49.787377 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:49.788298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:49.790932 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=79 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:49.920342 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:49.928243 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:49.929678 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:49.930825 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-17eb57e2-9905-42ec-b74c-184213444ba5 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1721 microversion: 2.20 time: 0.157541 Sep 13 06:52:49.931395 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 609/1228] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:49 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:50.956074 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:50.956686 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:50.959106 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=29 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:50.964237 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:50.964714 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:50.965143 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:50.965829 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:50.966275 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:50.966695 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:50.970945 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:51.100719 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:51.108615 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:51.110046 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:51.111193 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-c0196c39-b6aa-42d8-9b4f-e64af7a1e967 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1724 microversion: 2.20 time: 0.159219 Sep 13 06:52:51.111782 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 620/1229] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:50 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:51.136208 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-97f98e4e-8130-454d-9ac3-bc343e41ba78 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2294477-895c-43c2-929d-87993b2cbe3c"}} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:52:51.138528 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-97f98e4e-8130-454d-9ac3-bc343e41ba78 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:51.144726 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97f98e4e-8130-454d-9ac3-bc343e41ba78 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:51.145231 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97f98e4e-8130-454d-9ac3-bc343e41ba78 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:51.145858 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97f98e4e-8130-454d-9ac3-bc343e41ba78 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:51.146548 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97f98e4e-8130-454d-9ac3-bc343e41ba78 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:51.147001 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97f98e4e-8130-454d-9ac3-bc343e41ba78 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:51.147448 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-97f98e4e-8130-454d-9ac3-bc343e41ba78 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:51.420454 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-97f98e4e-8130-454d-9ac3-bc343e41ba78 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "POST /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288012 Sep 13 06:52:51.421075 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 610/1230] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Sep 13 06:52:51 2022] POST /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 06:52:51.545193 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-d12a9a8a-d849-4ec3-bc9f-5342abd565d8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:51.545719 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-d12a9a8a-d849-4ec3-bc9f-5342abd565d8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:51.551930 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d12a9a8a-d849-4ec3-bc9f-5342abd565d8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:51.552431 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d12a9a8a-d849-4ec3-bc9f-5342abd565d8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:51.552864 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d12a9a8a-d849-4ec3-bc9f-5342abd565d8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:51.553559 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d12a9a8a-d849-4ec3-bc9f-5342abd565d8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:51.554002 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d12a9a8a-d849-4ec3-bc9f-5342abd565d8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:51.554422 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-d12a9a8a-d849-4ec3-bc9f-5342abd565d8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:51.785341 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-d12a9a8a-d849-4ec3-bc9f-5342abd565d8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/os-volume_attachments/d2294477-895c-43c2-929d-87993b2cbe3c" status: 202 len: 0 microversion: 2.20 time: 0.244326 Sep 13 06:52:51.785993 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 621/1231] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Sep 13 06:52:51 2022] DELETE /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/os-volume_attachments/d2294477-895c-43c2-929d-87993b2cbe3c => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:52:51.847703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:52:51.848305 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:51.855157 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:51.855672 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:51.856107 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:51.856791 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:51.857237 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:51.857654 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:51.888348 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132398) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 06:52:51.953275 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [01855afa-3241-4599-83ef-1e941e484756] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 06:52:52.139955 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [req-02981cc7-271f-45b4-872b-cba4e2b8a79d req-1ea8e6b1-c1f7-45a0-9901-21993ae33bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a5aa36-85de-4d99-8755-d58f9136520d", "name": "network-vif-unplugged", "status": "completed", "tag": "50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4"}]} {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:52:52.151826 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-02981cc7-271f-45b4-872b-cba4e2b8a79d req-1ea8e6b1-c1f7-45a0-9901-21993ae33bf1 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:52.152314 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-02981cc7-271f-45b4-872b-cba4e2b8a79d req-1ea8e6b1-c1f7-45a0-9901-21993ae33bf1 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:52.152745 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [req-02981cc7-271f-45b4-872b-cba4e2b8a79d req-1ea8e6b1-c1f7-45a0-9901-21993ae33bf1 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:52.163204 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.compute.server_external_events [req-02981cc7-271f-45b4-872b-cba4e2b8a79d req-1ea8e6b1-c1f7-45a0-9901-21993ae33bf1 service nova] Unable to find a host for instance 04a5aa36-85de-4d99-8755-d58f9136520d. Dropping event network-vif-unplugged {{(pid=132399) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 06:52:52.164126 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [req-02981cc7-271f-45b4-872b-cba4e2b8a79d req-1ea8e6b1-c1f7-45a0-9901-21993ae33bf1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028124 Sep 13 06:52:52.164714 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 622/1232] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 13 06:52:52.961063 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO oslo.messaging._drivers.impl_rabbit [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [01855afa-3241-4599-83ef-1e941e484756] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38056. Sep 13 06:52:52.964239 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-e22621aa-619b-4089-b56f-ea1153c0b351 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "POST /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/action" status: 202 len: 0 microversion: 2.20 time: 1.121090 Sep 13 06:52:52.964842 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 611/1233] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Sep 13 06:52:51 2022] POST /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/action => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 06:52:52.972823 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:52.973435 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:52.979862 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:52.980342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:52.980775 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:52.981471 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:52.981925 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:52.982347 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:53.119036 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:53.127001 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:53.128485 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:53.129628 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ca5a19fd-f028-4dd7-b928-56dc65eba81c tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1672 microversion: 2.20 time: 0.160673 Sep 13 06:52:53.130181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 623/1234] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:52 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:54.156855 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:54.157423 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:54.163928 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:54.164417 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:54.164887 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:54.165592 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:54.166051 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:54.166484 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:54.352106 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:54.360925 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:54.362432 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:54.363808 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-44cd3e24-7906-4a30-822b-8481ca0eb4e2 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.211988 Sep 13 06:52:54.364367 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 612/1235] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:54 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:55.392925 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:55.396552 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:55.402886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:55.403781 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:55.404468 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:55.405405 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:55.406084 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:55.406726 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:55.548340 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:55.557686 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:55.559163 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:55.560433 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1662d12f-8280-4bab-b3f4-2ee652701613 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.174247 Sep 13 06:52:55.561207 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 624/1236] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:55 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:56.588135 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:56.588749 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:56.595006 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:56.595578 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:56.596019 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:56.596728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:56.597178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:56.597600 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:56.738290 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:56.747418 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:56.749205 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:56.750482 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-7be1ec3b-cda5-462f-a10c-4d4cb97a1e7a tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.168713 Sep 13 06:52:56.751337 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 613/1237] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:56 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:57.777113 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:57.777704 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:57.784296 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:57.784776 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:57.785204 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:57.785895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:57.786342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:57.786755 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:57.927712 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:57.938624 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:57.940081 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:57.941252 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5e51866c-9046-4f07-866e-e393551248bb tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.168069 Sep 13 06:52:57.941815 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 625/1238] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:57 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:52:58.968318 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:52:58.968923 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:52:58.975554 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:58.976042 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:58.976481 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:58.977201 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:52:58.977659 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:52:58.978088 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:52:59.148145 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:59.157293 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:59.158141 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:52:59.159321 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-2b9bd84b-20da-4013-8738-5d7465a866c4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.195082 Sep 13 06:52:59.159908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 614/1239] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:52:58 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:00.185317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:00.186060 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:00.192502 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:00.192972 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:00.193408 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:00.194363 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:00.194708 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:00.195135 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:00.445342 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:00.453978 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:00.455452 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:00.456628 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-1632216e-addc-4d81-a716-3dbdf9c1a3b8 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.275307 Sep 13 06:53:00.457212 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 626/1240] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:00 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:01.482193 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:01.482854 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:01.489544 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:01.489979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:01.490486 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:01.491697 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:01.492184 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:01.493560 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:01.697613 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:01.706479 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:01.708322 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:01.709841 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c5038b08-003f-464e-aa6a-97500c9d95b4 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.231561 Sep 13 06:53:01.710471 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 615/1241] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:01 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:02.738966 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:02.739653 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:02.746516 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:02.746998 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:02.747458 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:02.748147 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:02.748595 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:02.749012 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:02.878680 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:02.887196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:02.888654 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:02.889792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-97cbdb18-96e5-4017-99a6-90608b69dc62 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.157180 Sep 13 06:53:02.890346 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 627/1242] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:02 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:03.914720 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:03.915285 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:03.921909 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:03.922378 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:03.922804 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:03.923514 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:03.923965 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:03.924384 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:04.049233 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:04.057253 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:04.058709 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:04.059879 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-14d4afdb-9eea-4c42-98f1-985f59a4df33 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.149131 Sep 13 06:53:04.060435 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 616/1243] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:03 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:05.085855 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:05.086443 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:05.092843 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:05.093317 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:05.093746 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:05.094427 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:05.094874 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:05.095291 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:05.224173 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:05.232796 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:05.234223 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:05.235438 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-13fd5617-102f-4184-8112-4822f550c49d tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.153956 Sep 13 06:53:05.235940 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 628/1244] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:05 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:06.260448 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:06.261046 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:06.267501 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:06.267979 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:06.268406 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:06.269094 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:06.269537 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:06.269952 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:06.407178 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:06.415182 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:06.416643 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:06.418049 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-8c7c3c95-7d92-44a6-9863-e48882bb2e79 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.161275 Sep 13 06:53:06.418596 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 617/1245] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:06 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:07.443802 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:07.444441 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:07.451083 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:07.451745 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:07.452181 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:07.452870 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:07.453323 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:07.453745 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:07.607833 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:07.635434 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:07.637145 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:07.638541 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9e498922-dc7f-4d2c-8d87-cebeaee2b3fd tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.198670 Sep 13 06:53:07.651395 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 629/1246] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:07 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:08.681211 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:08.681824 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:08.688185 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:08.688683 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:08.689122 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:08.689846 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:08.690307 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:08.690737 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:08.827819 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:08.836463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:08.837861 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:08.839022 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-d792396a-edea-4c14-b3ef-eba9a5c86710 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.162086 Sep 13 06:53:08.839626 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 618/1247] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:08 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:09.864560 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:09.865093 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:09.871959 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:09.872436 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:09.872867 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:09.873546 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:09.873989 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:09.874404 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:10.003599 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:10.011585 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:10.013034 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:10.014196 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-7717f660-1963-4e2d-b668-f2adbb2b8b6b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.153630 Sep 13 06:53:10.014758 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 630/1248] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:09 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:53:10.212587 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-cfa703d3-7828-48a4-b0b1-4533e084f7e1 req-b5b0dd96-d672-47b3-a502-e2573feb0171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a5aa36-85de-4d99-8755-d58f9136520d", "name": "network-vif-plugged", "status": "completed", "tag": "50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:53:10.223079 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-cfa703d3-7828-48a4-b0b1-4533e084f7e1 req-b5b0dd96-d672-47b3-a502-e2573feb0171 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:10.223541 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-cfa703d3-7828-48a4-b0b1-4533e084f7e1 req-b5b0dd96-d672-47b3-a502-e2573feb0171 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:10.224009 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-cfa703d3-7828-48a4-b0b1-4533e084f7e1 req-b5b0dd96-d672-47b3-a502-e2573feb0171 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:10.236703 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-cfa703d3-7828-48a4-b0b1-4533e084f7e1 req-b5b0dd96-d672-47b3-a502-e2573feb0171 service nova] Creating event network-vif-plugged:50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4 for instance 04a5aa36-85de-4d99-8755-d58f9136520d on hv-cinder-85638 Sep 13 06:53:10.241714 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-cfa703d3-7828-48a4-b0b1-4533e084f7e1 req-b5b0dd96-d672-47b3-a502-e2573feb0171 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033257 Sep 13 06:53:10.242412 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 619/1249] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 06:53:11.039477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:11.040118 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:11.046764 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:11.047245 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:11.047712 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:11.048399 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:11.048857 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:11.049280 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:11.178513 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:11.187034 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:11.188513 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:11.189675 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-616dc997-c6c6-429c-90b4-86c79ac96629 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.154099 Sep 13 06:53:11.190241 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 631/1250] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:11 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:12.216431 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:12.217136 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:12.224133 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:12.224617 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:12.225059 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:12.225755 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:12.226214 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:12.226728 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:12.360941 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:12.369737 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:12.371491 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:12.372622 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-b0dc3ff5-f93b-441e-b41c-b47fcebf5cf7 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1730 microversion: 2.20 time: 0.160398 Sep 13 06:53:12.373152 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 620/1251] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:12 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:53:13.398514 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:53:13.399128 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:53:13.405666 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:13.406148 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:13.406583 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:13.407303 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:53:13.407804 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:53:13.408212 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:53:13.538210 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:13.546457 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:13.547921 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:53:13.549069 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-227913d5-ec87-483e-bb96-a7b37c07dea9 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1717 microversion: 2.20 time: 0.154960 Sep 13 06:53:13.549622 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 632/1252] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:53:13 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:54:08.908589 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-fb89d586-f296-4937-af08-aaea593e2674 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:08.910776 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-fb89d586-f296-4937-af08-aaea593e2674 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:54:08.913142 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:08.914458 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG dbcounter [-] [132398] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=132398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:08.915480 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 06:54:08.915664 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Tue Sep 13 06:54:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/os-volume_attachments (ip 10.222.0.17) !!! Sep 13 06:54:08.923995 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb89d586-f296-4937-af08-aaea593e2674 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:08.924474 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb89d586-f296-4937-af08-aaea593e2674 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:08.924908 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb89d586-f296-4937-af08-aaea593e2674 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:08.925597 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb89d586-f296-4937-af08-aaea593e2674 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:08.926050 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb89d586-f296-4937-af08-aaea593e2674 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:08.926470 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-fb89d586-f296-4937-af08-aaea593e2674 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:08.957807 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-fb89d586-f296-4937-af08-aaea593e2674 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053139 Sep 13 06:54:08.958357 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 621/1253] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Sep 13 06:54:08 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 06:54:09.021762 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9c844e00-6866-414e-b373-8a60a5219a72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:09.022297 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9c844e00-6866-414e-b373-8a60a5219a72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:54:09.025139 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_api:SELECT=25 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:09.025796 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG dbcounter [-] [132399] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=132399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:09.026978 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 06:54:09.027119 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Tue Sep 13 06:54:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d (ip 10.222.0.17) !!! Sep 13 06:54:09.035267 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9c844e00-6866-414e-b373-8a60a5219a72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:09.035798 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9c844e00-6866-414e-b373-8a60a5219a72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:09.036235 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9c844e00-6866-414e-b373-8a60a5219a72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:09.036933 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9c844e00-6866-414e-b373-8a60a5219a72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:09.037389 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9c844e00-6866-414e-b373-8a60a5219a72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:09.037820 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9c844e00-6866-414e-b373-8a60a5219a72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:09.064231 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9c844e00-6866-414e-b373-8a60a5219a72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Going to try to terminate instance {{(pid=132399) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 06:54:09.137201 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9c844e00-6866-414e-b373-8a60a5219a72 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 204 len: 0 microversion: 2.20 time: 0.119181 Sep 13 06:54:09.137836 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 633/1254] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Sep 13 06:54:09 2022] DELETE /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 06:54:09.146540 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:09.147158 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:54:09.153892 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:09.154396 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:09.154828 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:09.155562 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:09.156014 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:09.156436 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:09.561018 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:54:09.568976 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:54:09.571073 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.policy [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132398) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:54:09.572269 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ab482fb7-34ac-4f67-ada4-3a1543c63a3b tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.429660 Sep 13 06:54:09.572837 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 622/1255] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:54:09 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:54:10.597742 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:10.598450 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:54:10.604982 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:10.605460 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:10.605895 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:10.606640 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:10.607090 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:10.607537 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:10.735193 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:54:10.743295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:54:10.744760 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:54:10.745916 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ed19c378-64d8-464b-9381-6b373aed367f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1723 microversion: 2.20 time: 0.152505 Sep 13 06:54:10.746477 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 634/1256] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:54:10 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 06:54:11.756735 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [req-d59ac23d-4c80-418e-bb17-a3d12a3f1715 req-7a4c829c-8b09-4c53-9405-b56d542db873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a5aa36-85de-4d99-8755-d58f9136520d", "name": "network-vif-deleted", "tag": "50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4"}]} {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 06:54:11.771523 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:11.772112 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:54:11.778291 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-d59ac23d-4c80-418e-bb17-a3d12a3f1715 req-7a4c829c-8b09-4c53-9405-b56d542db873 service nova] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:11.778780 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-d59ac23d-4c80-418e-bb17-a3d12a3f1715 req-7a4c829c-8b09-4c53-9405-b56d542db873 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:11.779212 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [req-d59ac23d-4c80-418e-bb17-a3d12a3f1715 req-7a4c829c-8b09-4c53-9405-b56d542db873 service nova] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:11.785579 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:11.786161 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:11.786834 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:11.787790 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:11.788518 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:11.790433 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:11.792885 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.compute.server_external_events [req-d59ac23d-4c80-418e-bb17-a3d12a3f1715 req-7a4c829c-8b09-4c53-9405-b56d542db873 service nova] Creating event network-vif-deleted:50b48a07-28c1-48e4-a1c0-b8fe24b3bcc4 for instance 04a5aa36-85de-4d99-8755-d58f9136520d on hv-cinder-85638 Sep 13 06:54:11.798917 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [req-d59ac23d-4c80-418e-bb17-a3d12a3f1715 req-7a4c829c-8b09-4c53-9405-b56d542db873 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046520 Sep 13 06:54:11.800569 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 623/1257] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Sep 13 06:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 06:54:11.865413 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:54:11.874363 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:54:11.878436 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.policy [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b89305abaa14207b2840164c1a90e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a77de8686444581a7b5906cae6973f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132399) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 06:54:11.883878 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-5ab3443b-b8ae-44e3-91ee-599277a86495 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 200 len: 1366 microversion: 2.20 time: 0.112263 Sep 13 06:54:11.884641 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 635/1258] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:54:11 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 06:54:12.914016 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:12.914748 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:54:12.921232 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:12.921713 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:12.922150 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:12.922836 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:12.923293 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:12.923749 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:12.936691 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] HTTP exception thrown: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Request method failure captured: Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d HTTP/1.1 Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICcg-7wyunUQkmm3_CJp2JXyCKuf1A3xFLFOsQom-Gx5MQsTY3x6oomL2CEp52HUIRnUxzFlCIl3KE0jCxkkfeKlAZHu8VFy_P3OBSNng86Ts1ydgmnpN35oSWY_T6t1q-r2y5EKehsMdO_SP8FQzURyOoZyWJlgTTZ-hAQnIwRL5dQ Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:54:12.938298 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a77de8686444581a7b5906cae6973f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 6b89305abaa14207b2840164c1a90e7b Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:12.940256 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '04a5aa36-85de-4d99-8755-d58f9136520d'} Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:12.941452 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:12.943392 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:12.945506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Returning 404 to user: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:12.945506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-09f530cc-421a-4ca6-a03a-6bd34aada233 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 404 len: 111 microversion: 2.20 time: 0.030441 Sep 13 06:54:12.945506 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 624/1259] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:54:12 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 06:54:12.948967 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-cee8f704-63d1-46d8-95cd-e93dbdedcc71 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '.version_select at 0x7fdc0d2d75e0>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:12.968033 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-cee8f704-63d1-46d8-95cd-e93dbdedcc71 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-697843720" status: 204 len: 0 microversion: 2.20 time: 0.023409 Sep 13 06:54:12.968592 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 636/1260] 10.222.0.17 () {60 vars in 1259 bytes} [Tue Sep 13 06:54:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-697843720 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 06:54:14.723070 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:14.723614 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:54:14.729948 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:14.730428 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:14.730864 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:14.731577 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:14.732035 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:14.732463 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:14.745955 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] HTTP exception thrown: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Request method failure captured: Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: DELETE /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d HTTP/1.1 Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICcg-7wyunUQkmm3_CJp2JXyCKuf1A3xFLFOsQom-Gx5MQsTY3x6oomL2CEp52HUIRnUxzFlCIl3KE0jCxkkfeKlAZHu8VFy_P3OBSNng86Ts1ydgmnpN35oSWY_T6t1q-r2y5EKehsMdO_SP8FQzURyOoZyWJlgTTZ-hAQnIwRL5dQ Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:54:14.747536 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a77de8686444581a7b5906cae6973f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 6b89305abaa14207b2840164c1a90e7b Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:14.749358 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': '04a5aa36-85de-4d99-8755-d58f9136520d'} Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:14.750500 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:14.752241 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:14.753904 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Returning 404 to user: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:14.753904 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-c973136e-ced2-41f5-91d8-d05de36e9709 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 404 len: 111 microversion: 2.20 time: 0.029736 Sep 13 06:54:14.753904 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 625/1261] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Sep 13 06:54:14 2022] DELETE /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 06:54:14.758295 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:14.758900 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: 04a5aa36-85de-4d99-8755-d58f9136520d] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:54:14.765364 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:14.765845 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:14.766279 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:14.766969 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:14.767451 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:14.767886 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:14.780673 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] HTTP exception thrown: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Request method failure captured: Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d HTTP/1.1 Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICcg-7wyunUQkmm3_CJp2JXyCKuf1A3xFLFOsQom-Gx5MQsTY3x6oomL2CEp52HUIRnUxzFlCIl3KE0jCxkkfeKlAZHu8VFy_P3OBSNng86Ts1ydgmnpN35oSWY_T6t1q-r2y5EKehsMdO_SP8FQzURyOoZyWJlgTTZ-hAQnIwRL5dQ Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:54:14.782278 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a77de8686444581a7b5906cae6973f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 6b89305abaa14207b2840164c1a90e7b Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:14.784136 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': '04a5aa36-85de-4d99-8755-d58f9136520d'} Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:14.785259 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. Sep 13 06:54:14.786971 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:54:14.788438 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Returning 404 to user: Instance 04a5aa36-85de-4d99-8755-d58f9136520d could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:14.788438 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-ec415003-2310-45d9-850f-ba3a4db73b08 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d" status: 404 len: 111 microversion: 2.20 time: 0.030335 Sep 13 06:54:14.788438 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 637/1262] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:54:14 2022] GET /compute/v2.1/servers/04a5aa36-85de-4d99-8755-d58f9136520d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 06:54:15.919632 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:15.920123 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.compute.api [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132398) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:54:15.926379 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:15.926854 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:15.927284 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:15.927996 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:15.928451 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:15.928873 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG oslo_concurrency.lockutils [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:15.944315 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.wsgi [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] HTTP exception thrown: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Request method failure captured: Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: request: DELETE /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b HTTP/1.1 Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept: application/json Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Accept-Encoding: identity Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Connection: close Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Length: 0 Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Content-Type: application/json Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Host: 10.222.0.17 Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: Openstack-System-Scope: None Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: User-Agent: python-urllib3/1.26.12 Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Auth-Token: gAAAAABjICcg-7wyunUQkmm3_CJp2JXyCKuf1A3xFLFOsQom-Gx5MQsTY3x6oomL2CEp52HUIRnUxzFlCIl3KE0jCxkkfeKlAZHu8VFy_P3OBSNng86Ts1ydgmnpN35oSWY_T6t1q-r2y5EKehsMdO_SP8FQzURyOoZyWJlgTTZ-hAQnIwRL5dQ Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Id: None Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Domain-Name: None Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Identity-Status: Confirmed Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Is-Admin-Project: True Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Id: default Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Domain-Name: Default Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Role: reader,member Sep 13 06:54:15.945883 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Roles: reader,member Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a77de8686444581a7b5906cae6973f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Id: default Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Domain-Name: Default Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Id: 6b89305abaa14207b2840164c1a90e7b Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: method: > Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: exception: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:54:15.947827 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: action_args: {'id': 'fd984c2d-db41-44f6-9324-394602908a4b'} Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: {{(pid=132398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:15.948812 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:54:15.950445 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: ERROR nova.api.openstack.wsgi Sep 13 06:54:15.952036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: DEBUG nova.api.openstack.wsgi [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Returning 404 to user: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. {{(pid=132398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:15.952036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: INFO nova.api.openstack.requestlog [None req-ccd29e96-9788-4783-a296-d0b75728a9d0 tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 404 len: 111 microversion: 2.20 time: 0.031828 Sep 13 06:54:15.952036 dv-cinder-856385-1-iscsi devstack@n-api.service[132398]: [pid: 132398|app: 0|req: 626/1263] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Sep 13 06:54:15 2022] DELETE /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 06:54:15.955692 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Calling method '>' {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 06:54:15.956329 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.compute.api [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] [instance: fd984c2d-db41-44f6-9324-394602908a4b] Fetching instance by UUID {{(pid=132399) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 06:54:15.962396 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:15.962883 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:15.963319 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:15.964035 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Acquiring lock "e5983513-f545-4028-b6c7-d14599d1f916" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 06:54:15.964492 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 06:54:15.964917 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG oslo_concurrency.lockutils [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Lock "e5983513-f545-4028-b6c7-d14599d1f916" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 06:54:15.978654 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.wsgi [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] HTTP exception thrown: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Request method failure captured: Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: request: GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b HTTP/1.1 Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept: application/json Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Accept-Encoding: identity Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Connection: close Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Length: 0 Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Content-Type: application/json Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Host: 10.222.0.17 Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: Openstack-System-Scope: None Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: User-Agent: python-urllib3/1.26.12 Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Auth-Token: gAAAAABjICcg-7wyunUQkmm3_CJp2JXyCKuf1A3xFLFOsQom-Gx5MQsTY3x6oomL2CEp52HUIRnUxzFlCIl3KE0jCxkkfeKlAZHu8VFy_P3OBSNng86Ts1ydgmnpN35oSWY_T6t1q-r2y5EKehsMdO_SP8FQzURyOoZyWJlgTTZ-hAQnIwRL5dQ Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Id: None Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Domain-Name: None Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Identity-Status: Confirmed Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Is-Admin-Project: True Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Id: default Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Domain-Name: Default Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Role: reader,member Sep 13 06:54:15.980255 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Roles: reader,member Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a77de8686444581a7b5906cae6973f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a77de8686444581a7b5906cae6973f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Id: 1a77de8686444581a7b5906cae6973f5 Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2136399324 Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Id: default Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Domain-Name: Default Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Id: 6b89305abaa14207b2840164c1a90e7b Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2136399324-project Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: method: > Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: exception: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:54:15.981962 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: action_args: {'id': 'fd984c2d-db41-44f6-9324-394602908a4b'} Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: {{(pid=132399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 06:54:15.982792 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. Sep 13 06:54:15.984172 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: ERROR nova.api.openstack.wsgi Sep 13 06:54:15.985375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: DEBUG nova.api.openstack.wsgi [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] Returning 404 to user: Instance fd984c2d-db41-44f6-9324-394602908a4b could not be found. {{(pid=132399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 06:54:15.985375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: INFO nova.api.openstack.requestlog [None req-9bb26dbc-66b3-4ca4-a517-8cfddf377a2f tempest-AttachVolumeShelveTestJSON-2136399324 tempest-AttachVolumeShelveTestJSON-2136399324-project] 10.222.0.17 "GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b" status: 404 len: 111 microversion: 2.20 time: 0.029930 Sep 13 06:54:15.985375 dv-cinder-856385-1-iscsi devstack@n-api.service[132399]: [pid: 132399|app: 0|req: 638/1264] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Sep 13 06:54:15 2022] GET /compute/v2.1/servers/fd984c2d-db41-44f6-9324-394602908a4b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0)